Jul 30 20:19:13.327334 ip-10-0-142-180 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 20:19:13.327343 ip-10-0-142-180 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 20:19:13.327350 ip-10-0-142-180 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 20:19:13.327569 ip-10-0-142-180 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 20:19:23.115427 ip-10-0-142-180 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 20:19:23.115439 ip-10-0-142-180 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6597ee257b5043f990ff7074fda3c208 --
Jul 30 20:21:12.125009 ip-10-0-142-180 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 20:21:12.510649 ip-10-0-142-180 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:21:12.510649 ip-10-0-142-180 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 20:21:12.510649 ip-10-0-142-180 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:21:12.510649 ip-10-0-142-180 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 20:21:12.510649 ip-10-0-142-180 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 20:21:12.512842 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.512746    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 20:21:12.518662 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518640    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.518662 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518660    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518664    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518667    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518670    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518673    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518677    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518679    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518693    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518696    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518698    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518701    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518704    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518707    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518709    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518712    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518716    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518718    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518721    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518724    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.518741 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518727    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518730    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518733    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518736    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518738    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518741    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518744    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518747    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518750    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518752    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518755    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518758    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518760    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518763    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518765    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518768    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518770    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518773    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518776    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518779    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.519200 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518781    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518784    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518786    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518789    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518791    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518801    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518804    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518806    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518809    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518811    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518813    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518816    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518819    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518821    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518827    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518831    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518835    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518838    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518841    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.519719 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518844    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518847    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518850    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518853    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518855    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518858    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518862    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518866    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518869    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518872    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518875    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518878    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518881    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518884    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518887    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518890    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518892    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518895    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518898    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518901    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.520202 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518904    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518906    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518909    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518911    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518914    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518917    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518920    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518924    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518927    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518930    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518933    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518936    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518938    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518941    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518943    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518946    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518948    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518951    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518953    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.518956    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.520777 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519699    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519706    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519709    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519711    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519715    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519720    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519725    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519728    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519731    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519734    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519737    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519740    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519744    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519746    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519749    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519752    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519755    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519757    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519760    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.521259 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519763    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519766    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519768    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519771    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519774    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519777    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519780    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519783    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519786    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519788    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519791    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519793    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519796    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519799    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519801    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519804    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519806    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519809    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519811    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.521750 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519814    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519819    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519822    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519825    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519828    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519831    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519834    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519836    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519839    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519842    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519844    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519847    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519849    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519853    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519855    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519858    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519861    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519863    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519867    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.522219 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519870    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519873    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519875    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519878    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519880    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519883    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519886    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519888    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519891    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519893    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519896    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519899    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519901    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519904    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519907    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519910    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519913    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519915    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519919    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519922    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.522692 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519926    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519929    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519932    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519935    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519938    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519940    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519943    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519945    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519948    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519950    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519953    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519956    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519958    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519961    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519964    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519967    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519969    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519972    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519974    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519977    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.523188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519980    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.519982    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520388    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520394    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520397    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520400    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520403    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520406    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520408    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520413    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520416    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520420    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520423    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520427    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520429    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520432    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520434    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520437    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520440    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.523678 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520442    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520445    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520447    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520451    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520455    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520458    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520461    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520464    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520466    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520469    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520472    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520475    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520478    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520480    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520483    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520485    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520488    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520490    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520493    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520496    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.524151 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520499    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520502    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520504    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520507    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520509    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520512    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520514    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520517    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520519    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520522    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520524    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520527    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520530    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520532    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520534    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520537    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520539    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520542    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520545    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520547    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.524647 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520550    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520552    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520555    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520557    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520560    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520562    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520565    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520567    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520569    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520572    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520574    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520577    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520579    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520583    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520585    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520588    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520591    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520593    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520596    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520599    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.525157 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520601    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520604    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520606    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520609    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520611    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520614    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520616    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520619    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520621    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520624    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520627    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520630    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520633    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520635    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520638    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520641    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520645    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520648    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520651    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.525669 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520654    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520657    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.520660    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520752    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520760    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520769    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520775    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520780    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520784    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520788    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520793    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520796    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520799    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520802    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520806    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520809    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520813    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520816    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520819    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520822    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520825    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520830    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520833    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520837    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 20:21:12.526136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520840    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520844    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520852    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520855    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520858    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520861    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520865    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520868    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520871    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520874    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520877    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520881    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520884    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520890    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520893    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520896    2583 flags.go:64] FLAG: --enable-server="true"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520900    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520904    2583 flags.go:64] FLAG: --event-burst="100"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520908    2583 flags.go:64] FLAG: --event-qps="50"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520910    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520913    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520917    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520921    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520924    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520927    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 20:21:12.526736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520930    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520933    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520936    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520939    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520942    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520945    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520948    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520951    2583 flags.go:64] FLAG: --feature-gates=""
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520955    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520958    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520962    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520965    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520968    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520971    2583 flags.go:64] FLAG: --help="false"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520975    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520978    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520981    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520984    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520987    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520991    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520995    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.520998    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521000    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 20:21:12.527337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521003    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521007    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521010    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521013    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521016    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521019    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521022    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521027    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521030    2583 flags.go:64] FLAG: --lock-file=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521033    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521036    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521039    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521044    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521047    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521050    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521053    2583 flags.go:64] FLAG: --logging-format="text"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521056    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521060    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521063    2583 flags.go:64] FLAG: --manifest-url=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521066    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521071    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521074    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521078    2583 flags.go:64] FLAG: --max-pods="110"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521081    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521084    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 20:21:12.527932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521087    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521090    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521093    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521097    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521103    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521110    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521113    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521117    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521120    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521124    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521130    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521133    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521137    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521141    2583 flags.go:64] FLAG: --port="10250"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521145    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521148    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f23cf9e734048371"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521151    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521154    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521157    2583 flags.go:64] FLAG: --register-node="true"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521160    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521168    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521171    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521174    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521177    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521180    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 20:21:12.528574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521184    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521187    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521190    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521193    2583 flags.go:64] FLAG: --runonce="false"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521196    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521199    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521202    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521206    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521208    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521212    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521215    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521218    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521222    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521225    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521228    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521231    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521234    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521238    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521241    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521246    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521249    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521256    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521261    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521264    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521267    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 20:21:12.529337 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521270    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521273    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521276    2583 flags.go:64] FLAG: --v="2"
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521280    2583 flags.go:64] FLAG: --version="false"
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521285    2583 flags.go:64] FLAG: --vmodule=""
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521289    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.521292    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521410    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521415    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521419    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521423    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521426    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521429    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521431    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521435    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521437    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521440    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521442    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521445    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521448    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521451    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.529979 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521453    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521456    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521459    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521461    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521464    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521467    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521470    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521474    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521477    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521480    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521482    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521485    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521488    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521491    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521493    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521496    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521498    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521501    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521503    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521506    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.530496 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521508    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521511    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521513    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521516    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521518    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521521    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521523    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521526    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521528    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521531    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521534    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521537    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521539    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521542    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521545    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521547    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521550    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521553    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521556    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521560    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.531008 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521562    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521565    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521567    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521570    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521573    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521575    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521578    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521581    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521583    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521586    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521588    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521591    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521593    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521596    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521599    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521601    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521605    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521608    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521611    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.531507 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521614    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521617    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521620    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521623    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521626    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521629    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521632    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521635    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521637    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521640    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521643    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521646    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521650    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521653    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521655    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521658    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521660    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521663    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521666    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521668    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.531993 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521671    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521674    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521678    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521681    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521696    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.521699    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.523189    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.530938    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.530959    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.530979    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.530988    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531065    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531070    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531074    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.532500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531078    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531081    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531083    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531086    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531089    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531093    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531097    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531100    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531102    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531105    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531107    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531110    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531113    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531115    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531117    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531120    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531123    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531126    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531128    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531131    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.532867 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531133    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531136    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531139    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531141    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531143    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531146    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531156    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531159    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531162    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531164    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531167    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531169    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531172    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531175    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531177    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531179    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531186    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531188    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531191    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531193    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.533349 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531196    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531198    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531201    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531203    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531206    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531208    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531211    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531213    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531216    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531218    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531221    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531224    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531226    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531229    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531231    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531234    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531237    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531239    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531242    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531251    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.533858 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531254    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531256    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531259    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531262    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531264    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531268    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531272    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531274    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531277    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531280    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531283    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531286    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531288    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531291    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531295    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531298    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531301    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531304    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531307    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.534342 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531309    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531312    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531315    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531318    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531320    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531323    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531326    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531328    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531330    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531333    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531335    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531339    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531341    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531350    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531352    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531355    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.534822 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531357    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.531363    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531524    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531530    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531533    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531536    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531539    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531542    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531545    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531547    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531550    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531552    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531555    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531557    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531560    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 20:21:12.535227 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531562    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531565    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531568    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531570    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531573    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531575    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531578    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531581    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531583    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531586    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531588    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531591    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531594    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531596    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531599    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531608    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531611    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531613    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531616    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531618    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 20:21:12.535613 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531621    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531623    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531626    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531628    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531631    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531633    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531636    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531638    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531640    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531643    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531645    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531648    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531650    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531653    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531655    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531658    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531660    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531662    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531665    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531667    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 20:21:12.536110 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531670    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531673    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531675    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531678    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531697    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531702    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531705    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531709    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531718    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531721    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531724    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531727    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531729    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531732    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531735    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531738    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531740    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531744    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 20:21:12.536635 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531747    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531750    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531753    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531756    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531758    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531761    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531763    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531766    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531768    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531771    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531774    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531777    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531779    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531782    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531784    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531786    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531789    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531791    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531795    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531799    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 20:21:12.537188 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531802    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531805    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531808    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531816    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531819    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531822    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531825    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:12.531827    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.531833    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.531993    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.535157    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.536355    2583 server.go:1019] "Starting client certificate rotation"
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.536453    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:21:12.537674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.536505    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 20:21:12.541256 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.541219    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:21:12.542540 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.542516    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 20:21:12.550115 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.550096    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 30 20:21:12.552101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.552088    2583 log.go:25] "Validated CRI v1 image API"
Jul 30 20:21:12.552858 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.552839    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 20:21:12.555265 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.555241    2583 fs.go:135] Filesystem UUIDs: map[0198b2cb-a4e0-42cd-a6db-15821f79367f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c92943d1-a10d-4f5e-b43c-f0e5cb6ee8c4:/dev/nvme0n1p3]
Jul 30 20:21:12.555347 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.555262    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 20:21:12.561006 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.560873    2583 manager.go:216] Machine: {Timestamp:2026-07-30 20:21:12.559612545 +0000 UTC m=+0.322533070 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104516 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fca5e7762720a46dc869a5e734674 SystemUUID:ec2fca5e-7762-720a-46dc-869a5e734674 BootID:6597ee25-7b50-43f9-90ff-7074fda3c208 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:d9:31:df:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:d9:31:df:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:2d:45:bc:a1:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 20:21:12.561006 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.560990    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 20:21:12.561193 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.561113    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 20:21:12.564318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.564287    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 20:21:12.564507 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.564322    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-180.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 20:21:12.565065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.565052    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 20:21:12.565130 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.565071    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 20:21:12.565130 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.565088    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:21:12.565717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.565705    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 20:21:12.566695 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.566671    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 20:21:12.569890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.569873    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:21:12.570043 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570031    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 20:21:12.570101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570070    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 20:21:12.570101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570086    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 20:21:12.570183 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570107    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 20:21:12.570183 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570120    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 30 20:21:12.570183 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570133    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 20:21:12.570521 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570507    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:21:12.570585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.570529    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 20:21:12.571349 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.571316    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:21:12.572994 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.572977    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 20:21:12.574390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.574373    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 20:21:12.574479 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.574412    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 20:21:12.575640 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575626    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575647    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575656    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575664    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575678    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575701    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 20:21:12.575722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575717    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 20:21:12.575931 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575725    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 20:21:12.575931 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575737    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 20:21:12.575931 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575745    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 20:21:12.575931 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575760    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 20:21:12.575931 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.575779    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 20:21:12.576718 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.576706    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 20:21:12.576778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.576720    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 20:21:12.582086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.582058    2583 server.go:1268] "Started kubelet"
Jul 30 20:21:12.582181 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.582125    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 20:21:12.582235 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.582138    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 20:21:12.582435 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.582264    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 20:21:12.583146 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.583125    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-180.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 20:21:12.583257 ip-10-0-142-180 systemd[1]: Started Kubernetes Kubelet.
Jul 30 20:21:12.583468 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.583273    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 20:21:12.583468 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.583287    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 20:21:12.585804 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.585788    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 20:21:12.586840 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.586821    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 20:21:12.587450 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.587432    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 20:21:12.589356 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.588542    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-180.ec2.internal.18c72ad53b010955  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-180.ec2.internal,UID:ip-10-0-142-180.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-180.ec2.internal,},FirstTimestamp:2026-07-30 20:21:12.582015317 +0000 UTC m=+0.344935842,LastTimestamp:2026-07-30 20:21:12.582015317 +0000 UTC m=+0.344935842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-180.ec2.internal,}"
Jul 30 20:21:12.591368 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.591347    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 20:21:12.591368 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.591357    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 20:21:12.591516 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.591423    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.592136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592114    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 20:21:12.592136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592132    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 20:21:12.592136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592138    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 20:21:12.592290 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592231    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 20:21:12.592290 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592240    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 20:21:12.592840 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592823    2583 factory.go:55] Registering systemd factory
Jul 30 20:21:12.592840 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.592842    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 30 20:21:12.593065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593045    2583 factory.go:153] Registering CRI-O factory
Jul 30 20:21:12.593108 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593067    2583 factory.go:223] Registration of the crio container factory successfully
Jul 30 20:21:12.593139 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593120    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 20:21:12.593139 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593137    2583 factory.go:103] Registering Raw factory
Jul 30 20:21:12.593220 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593150    2583 manager.go:1196] Started watching for new ooms in manager
Jul 30 20:21:12.593487 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593468    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6268"
Jul 30 20:21:12.593583 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.593572    2583 manager.go:349] Starting recovery of all containers
Jul 30 20:21:12.602113 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.602086    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h6268"
Jul 30 20:21:12.602553 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.602538    2583 manager.go:354] Recovery completed
Jul 30 20:21:12.602960 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.602936    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 20:21:12.603065 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.603026    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-180.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 20:21:12.609106 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.609091    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.611548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.611528    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.611625 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.611566    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.611625 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.611581    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.612188 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.612173    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 20:21:12.612188 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.612183    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.612188 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.612188    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 20:21:12.612341 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.612205    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 20:21:12.617043 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617026    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.617099 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617055    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.617099 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617066    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.617383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617370    2583 policy_none.go:49] "None policy: Start"
Jul 30 20:21:12.617431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617390    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 20:21:12.617431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.617406    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 20:21:12.618444 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.618433    2583 policy_none.go:47] "Start"
Jul 30 20:21:12.662556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.662368    2583 manager.go:337] "Starting Device Plugin manager"
Jul 30 20:21:12.662732 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.662571    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 20:21:12.662732 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.662582    2583 server.go:87] "Starting device plugin registration server"
Jul 30 20:21:12.662854 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.662841    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 20:21:12.662887 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.662856    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 20:21:12.663110 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.662959    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 20:21:12.663110 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.663054    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 20:21:12.663110 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.663062    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 20:21:12.663823 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.663797    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 20:21:12.663908 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.663855    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.745697 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.745642    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 20:21:12.747200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.747177    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 20:21:12.747322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.747218    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 20:21:12.747322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.747242    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 20:21:12.747322 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.747286    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 20:21:12.749893 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.749871    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:12.763277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.763220    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.765572 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.765555    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.765639 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.765588    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.765639 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.765600    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.765639 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.765627    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.774979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.774961    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.775049 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.774985    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-180.ec2.internal\": node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.793667 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.793638    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.847645 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.847607    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"]
Jul 30 20:21:12.847821 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.847711    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.849356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.849337    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.849468 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.849375    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.849468 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.849390    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.850680 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.850662    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.850790 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.850776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.850844 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.850810    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.851978 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.851952    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.852073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.851980    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.852073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.851997    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.852073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.852028    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.852073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.852049    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.852073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.852060    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.853346 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.853330    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.853400 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.853356    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 20:21:12.854102 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.854088    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 20:21:12.854182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.854115    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 20:21:12.854182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.854125    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeHasSufficientPID"
Jul 30 20:21:12.874825 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.874797    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-180.ec2.internal\" not found" node="ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.879609 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.879591    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-180.ec2.internal\" not found" node="ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.894486 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.894455    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.894626 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.894538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.894626 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.894577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.894626 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.894619    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c9dc975cd59a33670a37382999ae928-config\") pod \"kube-apiserver-proxy-ip-10-0-142-180.ec2.internal\" (UID: \"1c9dc975cd59a33670a37382999ae928\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995158 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:12.995125    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:12.995255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c9dc975cd59a33670a37382999ae928-config\") pod \"kube-apiserver-proxy-ip-10-0-142-180.ec2.internal\" (UID: \"1c9dc975cd59a33670a37382999ae928\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995393 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995393 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c9dc975cd59a33670a37382999ae928-config\") pod \"kube-apiserver-proxy-ip-10-0-142-180.ec2.internal\" (UID: \"1c9dc975cd59a33670a37382999ae928\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:12.995393 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:12.995367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d45e1310fa5c8bfd9b22ddf2d48f7366-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal\" (UID: \"d45e1310fa5c8bfd9b22ddf2d48f7366\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:13.096293 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.096214    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:13.183980 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.183951    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:13.184079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.183959    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:13.196625 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.196595    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:13.297789 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.297741    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:13.398242 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.398151    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-180.ec2.internal\" not found"
Jul 30 20:21:13.408720 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.408687    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:13.492453 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.492424    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:13.506462 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.506432    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:21:13.508330 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.508311    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal"
Jul 30 20:21:13.519475 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.519450    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 20:21:13.535722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.535687    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 20:21:13.535897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.535867    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 20:21:13.536008 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.535911    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 20:21:13.572700 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.572658    2583 apiserver.go:52] "Watching apiserver"
Jul 30 20:21:13.591884 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.591749    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 20:21:13.595716 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.595687    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 20:21:13.596127 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.596103    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-wpprs","openshift-ovn-kubernetes/ovnkube-node-gwtt9","kube-system/global-pull-secret-syncer-x9vtn","kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal","openshift-cluster-node-tuning-operator/tuned-t2m8t","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal","openshift-multus/network-metrics-daemon-8v5lt","openshift-network-operator/iptables-alerter-sx9mh","kube-system/konnectivity-agent-cdnwm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp","openshift-dns/node-resolver-4gl6w","openshift-image-registry/node-ca-mbb46","openshift-multus/multus-additional-cni-plugins-rjrvx","openshift-multus/multus-r4mzh"]
Jul 30 20:21:13.597485 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.597462    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.598776 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.598753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.600087 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.600065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.601379 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.601357    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:13.601472 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.601425    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:13.602202 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.602187    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 20:21:13.602632 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.602617    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.603150 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603128    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 20:21:13.603522 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603507    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.603608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603565    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 20:21:13.603608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603576    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 20:21:13.603608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603587    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.603608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603596    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 20:21:13.603817 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603748    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52d8c\""
Jul 30 20:21:13.603995 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.603970    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.604127 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.604044    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 20:21:13.604191 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.604149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.604579 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.604559    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.604765 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.604688    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8rqbh\""
Jul 30 20:21:13.605392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.605372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.605708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.605687    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 20:21:13.605823 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.605760    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-955jf\""
Jul 30 20:21:13.605823 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.605785    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 20:21:13.606559 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.606521    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 20:16:12 +0000 UTC" deadline="2028-05-02 05:19:35.702957766 +0000 UTC"
Jul 30 20:21:13.606559 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.606548    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.606559 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.606551    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15392h58m22.096410316s"
Jul 30 20:21:13.608320 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.608301    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.608452 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.608354    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:13.608911 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.608890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.609034 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.608890    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.609140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.609102    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 20:21:13.610704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.609811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.610704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.609846    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zslzk\""
Jul 30 20:21:13.610704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.610094    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.610704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.610486    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pwxlr\""
Jul 30 20:21:13.610704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.610589    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.611124 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611084    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.611308 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611286    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.612002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611410    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 20:21:13.612002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611472    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.612002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611490    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 20:21:13.612002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.611838    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.612255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.612070    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2pxpq\""
Jul 30 20:21:13.612255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.612072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8npwj\""
Jul 30 20:21:13.613379 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.612878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.614090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.613813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 20:21:13.614296 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.614276    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fq9fk\""
Jul 30 20:21:13.615823 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.615794    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.615912 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.615794    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 20:21:13.615912 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.615887    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:13.616571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.616556    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 20:21:13.616730 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.616714    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 20:21:13.616820 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.616799    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-626sr\""
Jul 30 20:21:13.617060 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.617047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 20:21:13.638472 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.638451    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vvz9j"
Jul 30 20:21:13.651340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.651281    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vvz9j"
Jul 30 20:21:13.693244 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.693218    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 20:21:13.700640 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e559ea1-db0c-4813-96d4-36fd94044e75-hosts-file\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.700783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e559ea1-db0c-4813-96d4-36fd94044e75-tmp-dir\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.700783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700691    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-slash\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.700783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-log-socket\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.700932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-os-release\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.700932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-conf-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.700932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjbc5\" (UniqueName: \"kubernetes.io/projected/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-kube-api-access-tjbc5\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.700932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-host\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.701086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-netd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-daemon-config\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.701086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.700990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-registration-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.701086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7vq\" (UniqueName: \"kubernetes.io/projected/1a242a95-6640-447a-be01-a4c844d71db4-kube-api-access-7j7vq\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.701086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-kubernetes\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-lib-modules\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-node-log\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-env-overrides\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701227    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zffdr\" (UniqueName: \"kubernetes.io/projected/83b7df1b-3a67-452f-b7cf-1b40fae23455-kube-api-access-zffdr\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-config\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701313    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-sys-fs\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.701364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701346    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-system-cni-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-cnibin\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtbl\" (UniqueName: \"kubernetes.io/projected/3f2dec94-5116-4659-b81d-12d6ceac798f-kube-api-access-vgtbl\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-konnectivity-ca\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-kubelet\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-systemd\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-etc-tuned\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701590    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-netns\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-multus\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4sp2\" (UniqueName: \"kubernetes.io/projected/5e559ea1-db0c-4813-96d4-36fd94044e75-kube-api-access-f4sp2\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.701778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-kubelet-config\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-tmp\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4zm\" (UniqueName: \"kubernetes.io/projected/98044501-100d-4079-adf3-db37c041db9f-kube-api-access-tl4zm\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701874    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-etc-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701915    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-bin\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.701992    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-var-lib-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-ovn\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-script-lib\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-k8s-cni-cncf-io\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-multus-certs\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-etc-kubernetes\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-conf\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.702536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-sys\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702282    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-system-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-socket-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwnw\" (UniqueName: \"kubernetes.io/projected/8fbc0d92-e937-4036-a986-5fb00541214b-kube-api-access-qlwnw\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-run\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f2dec94-5116-4659-b81d-12d6ceac798f-host-slash\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702573    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-netns\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-socket-dir-parent\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-bin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-systemd-units\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cnibin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-serviceca\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-device-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.703352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-dbus\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovn-node-metrics-cert\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzbq\" (UniqueName: \"kubernetes.io/projected/a2086f96-b861-4fdd-b126-c5c1b58fbac3-kube-api-access-cnzbq\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-kubelet\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-os-release\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cni-binary-copy\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.702994    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f2dec94-5116-4659-b81d-12d6ceac798f-iptables-alerter-script\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysconfig\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-var-lib-kubelet\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703068    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-systemd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c92f\" (UniqueName: \"kubernetes.io/projected/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-kube-api-access-2c92f\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-host\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-modprobe-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-agent-certs\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-hostroot\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.703868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.703302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.769055 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.769015    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9dc975cd59a33670a37382999ae928.slice/crio-ef7f6e0463934803b3b272df5fe7876181e4f6812470c5a2dc128c6045e8bbd6 WatchSource:0}: Error finding container ef7f6e0463934803b3b272df5fe7876181e4f6812470c5a2dc128c6045e8bbd6: Status 404 returned error can't find the container with id ef7f6e0463934803b3b272df5fe7876181e4f6812470c5a2dc128c6045e8bbd6
Jul 30 20:21:13.771500 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.771474    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd45e1310fa5c8bfd9b22ddf2d48f7366.slice/crio-ce4d3200436dd2b98404bbd0ce89533539e5ebc2f2164984cee96538b509204c WatchSource:0}: Error finding container ce4d3200436dd2b98404bbd0ce89533539e5ebc2f2164984cee96538b509204c: Status 404 returned error can't find the container with id ce4d3200436dd2b98404bbd0ce89533539e5ebc2f2164984cee96538b509204c
Jul 30 20:21:13.773123 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.773107    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:21:13.803653 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-run\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.803653 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f2dec94-5116-4659-b81d-12d6ceac798f-host-slash\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-netns\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-socket-dir-parent\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-bin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f2dec94-5116-4659-b81d-12d6ceac798f-host-slash\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-netns\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-run\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-systemd-units\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-socket-dir-parent\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-bin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cnibin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.803870 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803853    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-systemd-units\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-serviceca\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cnibin\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-device-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-dbus\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-device-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.803992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovn-node-metrics-cert\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzbq\" (UniqueName: \"kubernetes.io/projected/a2086f96-b861-4fdd-b126-c5c1b58fbac3-kube-api-access-cnzbq\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-kubelet\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-os-release\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-dbus\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cni-binary-copy\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804126    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f2dec94-5116-4659-b81d-12d6ceac798f-iptables-alerter-script\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-kubelet\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysconfig\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.804414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804194    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-os-release\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-var-lib-kubelet\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-systemd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c92f\" (UniqueName: \"kubernetes.io/projected/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-kube-api-access-2c92f\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysconfig\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-host\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-var-lib-kubelet\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804305    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-host\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-systemd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-serviceca\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-modprobe-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-agent-certs\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-hostroot\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f2dec94-5116-4659-b81d-12d6ceac798f-iptables-alerter-script\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.805163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-modprobe-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804803    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-hostroot\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-cni-binary-copy\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e559ea1-db0c-4813-96d4-36fd94044e75-hosts-file\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-cni-binary-copy\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e559ea1-db0c-4813-96d4-36fd94044e75-tmp-dir\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5e559ea1-db0c-4813-96d4-36fd94044e75-hosts-file\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.804982    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-slash\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-log-socket\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-os-release\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-slash\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-conf-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjbc5\" (UniqueName: \"kubernetes.io/projected/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-kube-api-access-tjbc5\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805087    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-log-socket\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-host\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-netd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805123    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-conf-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-daemon-config\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.805957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-registration-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-os-release\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8fbc0d92-e937-4036-a986-5fb00541214b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7vq\" (UniqueName: \"kubernetes.io/projected/1a242a95-6640-447a-be01-a4c844d71db4-kube-api-access-7j7vq\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805208    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-host\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-kubernetes\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805257    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e559ea1-db0c-4813-96d4-36fd94044e75-tmp-dir\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-lib-modules\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-kubernetes\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-node-log\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-env-overrides\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-netd\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zffdr\" (UniqueName: \"kubernetes.io/projected/83b7df1b-3a67-452f-b7cf-1b40fae23455-kube-api-access-zffdr\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-registration-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-node-log\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-config\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.806793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-sys-fs\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-system-cni-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-cnibin\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-lib-modules\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtbl\" (UniqueName: \"kubernetes.io/projected/3f2dec94-5116-4659-b81d-12d6ceac798f-kube-api-access-vgtbl\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-daemon-config\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-konnectivity-ca\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805653    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-sys-fs\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805663    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-system-cni-dir\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-kubelet\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fbc0d92-e937-4036-a986-5fb00541214b-cnibin\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-kubelet\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-systemd\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-etc-tuned\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-multus-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.807614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-systemd\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-env-overrides\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.805876    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-netns\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.805947    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:14.305926522 +0000 UTC m=+2.068847054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-multus\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805963    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.805976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4sp2\" (UniqueName: \"kubernetes.io/projected/5e559ea1-db0c-4813-96d4-36fd94044e75-kube-api-access-f4sp2\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-netns\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-kubelet-config\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-tmp\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4zm\" (UniqueName: \"kubernetes.io/projected/98044501-100d-4079-adf3-db37c041db9f-kube-api-access-tl4zm\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.808237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806152    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-konnectivity-ca\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-etc-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-bin\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-etc-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-var-lib-cni-multus\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-var-lib-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806314    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21c16074-1a8f-4b64-928f-97d5d546fa1f-kubelet-config\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-ovn\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-script-lib\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-host-cni-bin\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-k8s-cni-cncf-io\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-multus-certs\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-etc-kubernetes\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.808781 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.806445    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.806507    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:14.306490647 +0000 UTC m=+2.069411171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-conf\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806605    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-run-ovn\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-d\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-config\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806445    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-etc-sysctl-conf\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-sys\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-system-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-socket-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-k8s-cni-cncf-io\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwnw\" (UniqueName: \"kubernetes.io/projected/8fbc0d92-e937-4036-a986-5fb00541214b-kube-api-access-qlwnw\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-etc-kubernetes\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-host-run-multus-certs\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.806913    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2086f96-b861-4fdd-b126-c5c1b58fbac3-var-lib-openvswitch\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.807031    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-system-cni-dir\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.809266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.807040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98044501-100d-4079-adf3-db37c041db9f-sys\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.807065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.807160    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovnkube-script-lib\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.807164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1a242a95-6640-447a-be01-a4c844d71db4-socket-dir\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.808137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-etc-tuned\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.808144    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2086f96-b861-4fdd-b126-c5c1b58fbac3-ovn-node-metrics-cert\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.808174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98044501-100d-4079-adf3-db37c041db9f-tmp\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.809806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.808308    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4f6653e8-4c5b-432e-b1a0-e7c84d86beca-agent-certs\") pod \"konnectivity-agent-cdnwm\" (UID: \"4f6653e8-4c5b-432e-b1a0-e7c84d86beca\") " pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.821859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.821837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjbc5\" (UniqueName: \"kubernetes.io/projected/29a9a83d-67a7-4c58-ba77-2b3d3f083d36-kube-api-access-tjbc5\") pod \"node-ca-mbb46\" (UID: \"29a9a83d-67a7-4c58-ba77-2b3d3f083d36\") " pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.822190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.822171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzbq\" (UniqueName: \"kubernetes.io/projected/a2086f96-b861-4fdd-b126-c5c1b58fbac3-kube-api-access-cnzbq\") pod \"ovnkube-node-gwtt9\" (UID: \"a2086f96-b861-4fdd-b126-c5c1b58fbac3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.823814 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.823789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7vq\" (UniqueName: \"kubernetes.io/projected/1a242a95-6640-447a-be01-a4c844d71db4-kube-api-access-7j7vq\") pod \"aws-ebs-csi-driver-node-rlpzp\" (UID: \"1a242a95-6640-447a-be01-a4c844d71db4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:13.824428 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.824406    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:13.824526 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.824432    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:13.824526 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.824447    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:13.824526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.824460    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtbl\" (UniqueName: \"kubernetes.io/projected/3f2dec94-5116-4659-b81d-12d6ceac798f-kube-api-access-vgtbl\") pod \"iptables-alerter-sx9mh\" (UID: \"3f2dec94-5116-4659-b81d-12d6ceac798f\") " pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:13.824526 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:13.824512    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:14.324492928 +0000 UTC m=+2.087413452 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:13.826109 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.826078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwnw\" (UniqueName: \"kubernetes.io/projected/8fbc0d92-e937-4036-a986-5fb00541214b-kube-api-access-qlwnw\") pod \"multus-additional-cni-plugins-rjrvx\" (UID: \"8fbc0d92-e937-4036-a986-5fb00541214b\") " pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:13.826303 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.826283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4sp2\" (UniqueName: \"kubernetes.io/projected/5e559ea1-db0c-4813-96d4-36fd94044e75-kube-api-access-f4sp2\") pod \"node-resolver-4gl6w\" (UID: \"5e559ea1-db0c-4813-96d4-36fd94044e75\") " pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:13.826381 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.826326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4zm\" (UniqueName: \"kubernetes.io/projected/98044501-100d-4079-adf3-db37c041db9f-kube-api-access-tl4zm\") pod \"tuned-t2m8t\" (UID: \"98044501-100d-4079-adf3-db37c041db9f\") " pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.826847 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.826826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zffdr\" (UniqueName: \"kubernetes.io/projected/83b7df1b-3a67-452f-b7cf-1b40fae23455-kube-api-access-zffdr\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:13.827866 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.827849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c92f\" (UniqueName: \"kubernetes.io/projected/402f86ca-489f-4fd7-b95c-cfe1d3528d2f-kube-api-access-2c92f\") pod \"multus-r4mzh\" (UID: \"402f86ca-489f-4fd7-b95c-cfe1d3528d2f\") " pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.853770 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.853741    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:13.928154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.928063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:13.935641 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.935615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:13.938339 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.938313    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6653e8_4c5b_432e_b1a0_e7c84d86beca.slice/crio-0231b81582fe7326f39e648b3454a9622e754878bf4dff5e9d52a1a7d28dd229 WatchSource:0}: Error finding container 0231b81582fe7326f39e648b3454a9622e754878bf4dff5e9d52a1a7d28dd229: Status 404 returned error can't find the container with id 0231b81582fe7326f39e648b3454a9622e754878bf4dff5e9d52a1a7d28dd229
Jul 30 20:21:13.944285 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.944253    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2086f96_b861_4fdd_b126_c5c1b58fbac3.slice/crio-11cd54bd36f12733428da5f30b325c79058b86f889093ee4f54303c99b544007 WatchSource:0}: Error finding container 11cd54bd36f12733428da5f30b325c79058b86f889093ee4f54303c99b544007: Status 404 returned error can't find the container with id 11cd54bd36f12733428da5f30b325c79058b86f889093ee4f54303c99b544007
Jul 30 20:21:13.957993 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.957969    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r4mzh"
Jul 30 20:21:13.962858 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.962839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2m8t"
Jul 30 20:21:13.967651 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.967628    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402f86ca_489f_4fd7_b95c_cfe1d3528d2f.slice/crio-39b660b8db647ffb7fafdc5ac1fcb594288496c61d76ea94ace7c55d0d7dae4a WatchSource:0}: Error finding container 39b660b8db647ffb7fafdc5ac1fcb594288496c61d76ea94ace7c55d0d7dae4a: Status 404 returned error can't find the container with id 39b660b8db647ffb7fafdc5ac1fcb594288496c61d76ea94ace7c55d0d7dae4a
Jul 30 20:21:13.974186 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.974163    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98044501_100d_4079_adf3_db37c041db9f.slice/crio-341ff854de27791e4a4bc706f56a0627c1e30c8ea3614753b093a1f09503cd22 WatchSource:0}: Error finding container 341ff854de27791e4a4bc706f56a0627c1e30c8ea3614753b093a1f09503cd22: Status 404 returned error can't find the container with id 341ff854de27791e4a4bc706f56a0627c1e30c8ea3614753b093a1f09503cd22
Jul 30 20:21:13.984637 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.984618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mbb46"
Jul 30 20:21:13.993971 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:13.993945    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a9a83d_67a7_4c58_ba77_2b3d3f083d36.slice/crio-759fa5df5eefbeab4d92c27fe62bfbd8312124d923c399e8a81248a2e3aedb17 WatchSource:0}: Error finding container 759fa5df5eefbeab4d92c27fe62bfbd8312124d923c399e8a81248a2e3aedb17: Status 404 returned error can't find the container with id 759fa5df5eefbeab4d92c27fe62bfbd8312124d923c399e8a81248a2e3aedb17
Jul 30 20:21:14.000006 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:13.999989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp"
Jul 30 20:21:14.019586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.019567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sx9mh"
Jul 30 20:21:14.025383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.025362    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gl6w"
Jul 30 20:21:14.027769 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:14.027744    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2dec94_5116_4659_b81d_12d6ceac798f.slice/crio-a2247dfaa39bd8baca34ec1c93dba08b565b3d730a092ab15d7278dd0dc86d5c WatchSource:0}: Error finding container a2247dfaa39bd8baca34ec1c93dba08b565b3d730a092ab15d7278dd0dc86d5c: Status 404 returned error can't find the container with id a2247dfaa39bd8baca34ec1c93dba08b565b3d730a092ab15d7278dd0dc86d5c
Jul 30 20:21:14.033548 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:14.033526    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e559ea1_db0c_4813_96d4_36fd94044e75.slice/crio-8e41c7f7b8e1b93870db1443f7ab35757f2781c97938934cb1c7c7b31f33f99f WatchSource:0}: Error finding container 8e41c7f7b8e1b93870db1443f7ab35757f2781c97938934cb1c7c7b31f33f99f: Status 404 returned error can't find the container with id 8e41c7f7b8e1b93870db1443f7ab35757f2781c97938934cb1c7c7b31f33f99f
Jul 30 20:21:14.039172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.039152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rjrvx"
Jul 30 20:21:14.049201 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:14.049174    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbc0d92_e937_4036_a986_5fb00541214b.slice/crio-b9e56e1d9487a9738181706164bef17e6638c8eb4a5fd741c3f62fe85a96cdef WatchSource:0}: Error finding container b9e56e1d9487a9738181706164bef17e6638c8eb4a5fd741c3f62fe85a96cdef: Status 404 returned error can't find the container with id b9e56e1d9487a9738181706164bef17e6638c8eb4a5fd741c3f62fe85a96cdef
Jul 30 20:21:14.186294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.186210    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:14.309990 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.309954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:14.310172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.310007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:14.310256 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.310183    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:14.310309 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.310260    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:15.310239992 +0000 UTC m=+3.073160506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:14.310821 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.310382    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:14.310821 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.310431    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:15.310416029 +0000 UTC m=+3.073336557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:14.411132 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.411086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:14.411292 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.411273    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:14.411367 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.411298    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:14.411367 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.411313    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:14.411472 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.411379    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:15.411357751 +0000 UTC m=+3.174278284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:14.654903 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.654780    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:16:13 +0000 UTC" deadline="2027-12-23 23:56:38.266184665 +0000 UTC"
Jul 30 20:21:14.654903 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.654841    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12267h35m23.61134782s"
Jul 30 20:21:14.748829 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.748801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:14.749016 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:14.748921    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:14.783933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.783873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gl6w" event={"ID":"5e559ea1-db0c-4813-96d4-36fd94044e75","Type":"ContainerStarted","Data":"8e41c7f7b8e1b93870db1443f7ab35757f2781c97938934cb1c7c7b31f33f99f"}
Jul 30 20:21:14.793835 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.793798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx9mh" event={"ID":"3f2dec94-5116-4659-b81d-12d6ceac798f","Type":"ContainerStarted","Data":"a2247dfaa39bd8baca34ec1c93dba08b565b3d730a092ab15d7278dd0dc86d5c"}
Jul 30 20:21:14.807325 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.807288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2m8t" event={"ID":"98044501-100d-4079-adf3-db37c041db9f","Type":"ContainerStarted","Data":"341ff854de27791e4a4bc706f56a0627c1e30c8ea3614753b093a1f09503cd22"}
Jul 30 20:21:14.818711 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.818659    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdnwm" event={"ID":"4f6653e8-4c5b-432e-b1a0-e7c84d86beca","Type":"ContainerStarted","Data":"0231b81582fe7326f39e648b3454a9622e754878bf4dff5e9d52a1a7d28dd229"}
Jul 30 20:21:14.833832 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.833793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal" event={"ID":"d45e1310fa5c8bfd9b22ddf2d48f7366","Type":"ContainerStarted","Data":"ce4d3200436dd2b98404bbd0ce89533539e5ebc2f2164984cee96538b509204c"}
Jul 30 20:21:14.850660 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.850621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal" event={"ID":"1c9dc975cd59a33670a37382999ae928","Type":"ContainerStarted","Data":"ef7f6e0463934803b3b272df5fe7876181e4f6812470c5a2dc128c6045e8bbd6"}
Jul 30 20:21:14.856429 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.856391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerStarted","Data":"b9e56e1d9487a9738181706164bef17e6638c8eb4a5fd741c3f62fe85a96cdef"}
Jul 30 20:21:14.858019 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.857984    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp" event={"ID":"1a242a95-6640-447a-be01-a4c844d71db4","Type":"ContainerStarted","Data":"94ba1132734b062b091ea7982f48d782509d51e350bc589c15a638a7516ef658"}
Jul 30 20:21:14.869916 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.869882    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mbb46" event={"ID":"29a9a83d-67a7-4c58-ba77-2b3d3f083d36","Type":"ContainerStarted","Data":"759fa5df5eefbeab4d92c27fe62bfbd8312124d923c399e8a81248a2e3aedb17"}
Jul 30 20:21:14.880084 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.880044    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4mzh" event={"ID":"402f86ca-489f-4fd7-b95c-cfe1d3528d2f","Type":"ContainerStarted","Data":"39b660b8db647ffb7fafdc5ac1fcb594288496c61d76ea94ace7c55d0d7dae4a"}
Jul 30 20:21:14.885526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:14.885495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"11cd54bd36f12733428da5f30b325c79058b86f889093ee4f54303c99b544007"}
Jul 30 20:21:15.074977 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.074945    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:15.318325 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.318257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:15.318512 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.318346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:15.318512 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.318508    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:15.318641 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.318572    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:17.318552701 +0000 UTC m=+5.081473216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:15.318999 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.318979    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:15.319098 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.319042    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:17.319025063 +0000 UTC m=+5.081945578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:15.419669 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.419586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:15.419889 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.419823    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:15.419889 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.419845    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:15.419889 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.419858    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:15.420067 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.419916    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:17.419898095 +0000 UTC m=+5.182818629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:15.655821 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.655771    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:16:13 +0000 UTC" deadline="2028-03-28 18:28:11.264209068 +0000 UTC"
Jul 30 20:21:15.655821 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.655819    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14566h6m55.608396034s"
Jul 30 20:21:15.748065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.748030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:15.748245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:15.748085    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:15.748245 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.748172    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:15.748374 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:15.748310    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:16.358401 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:16.358368    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 20:21:16.750708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:16.750665    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:16.751186 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:16.750816    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:17.341712 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:17.341583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:17.341712 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:17.341663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:17.341964 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.341782    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:17.341964 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.341859    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:17.341964 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.341913    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:21.341854081 +0000 UTC m=+9.104774608 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:17.341964 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.341937    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:21.34192697 +0000 UTC m=+9.104847482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:17.442126 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:17.442084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:17.442306 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.442287    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:17.442384 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.442319    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:17.442384 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.442335    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:17.442483 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.442405    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:21.442384756 +0000 UTC m=+9.205305271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:17.748677 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:17.748140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:17.748677 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.748290    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:17.748677 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:17.748599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:17.749009 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:17.748746    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:18.750500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:18.750449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:18.751044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:18.750576    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:19.748147 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:19.748094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:19.748335 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:19.748226    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:19.748432 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:19.748094    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:19.748557 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:19.748524    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:20.752715 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:20.752221    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:20.752715 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:20.752343    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:21.375128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:21.375179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.375349    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.375458    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.375508    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:29.375489854 +0000 UTC m=+17.138410369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:21.375920 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.375887    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:29.375868211 +0000 UTC m=+17.138788725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:21.475902 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:21.475871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:21.476076 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.476034    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:21.476076 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.476055    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:21.476076 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.476070    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:21.476211 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.476135    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:29.476116313 +0000 UTC m=+17.239036828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:21.748409 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:21.747744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:21.748409 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.747879    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:21.748409 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:21.748248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:21.748409 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:21.748355    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:22.750860 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:22.750826    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:22.751280 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:22.750938    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:23.747744 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:23.747709    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:23.747934 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:23.747707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:23.747934 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:23.747863    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:23.747934 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:23.747913    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:24.748164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:24.748128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:24.748540 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:24.748251    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:25.747681 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:25.747638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:25.747681 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:25.747680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:25.747919 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:25.747799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:25.748474 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:25.748436    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:26.747727 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:26.747692    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:26.747933 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:26.747824    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:27.748331 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:27.748292    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:27.748827 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:27.748352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:27.748827 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:27.748427    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:27.748827 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:27.748587    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:28.748407 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:28.748366    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:28.748875 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:28.748501    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:29.446092 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:29.446053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:29.446290 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:29.446106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:29.446290 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.446256    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:29.446290 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.446260    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:29.446437 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.446325    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:21:45.446307914 +0000 UTC m=+33.209228428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:29.446437 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.446346    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:45.446335354 +0000 UTC m=+33.209255870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:29.546924 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:29.546824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:29.547091 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.547021    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:29.547091 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.547046    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:29.547091 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.547057    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:29.547214 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.547111    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:45.547096108 +0000 UTC m=+33.310016620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:29.747530 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:29.747496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:29.747760 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.747622    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:29.747760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:29.747641    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:29.747873 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:29.747782    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:30.748529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:30.748490    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:30.749067 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:30.748633    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:31.748312 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:31.748278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:31.748483 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:31.748282    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:31.748483 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:31.748392    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:31.748572 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:31.748499    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:32.748316 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:32.748278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:32.748514 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:32.748407    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:33.748390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.748227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:33.748730 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.748292    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:33.748730 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:33.748483    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:33.748730 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:33.748613    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:33.931022 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.930941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r4mzh" event={"ID":"402f86ca-489f-4fd7-b95c-cfe1d3528d2f","Type":"ContainerStarted","Data":"5f09059db1700f8655ae25da94cb60d9c778afb390b53e7d84c1047266759744"}
Jul 30 20:21:33.936486 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.936198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"e565c6d7da37f77b24d30949c36148bfa270859947918792045f0e4d928efcb3"}
Jul 30 20:21:33.944801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.944615    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2m8t" event={"ID":"98044501-100d-4079-adf3-db37c041db9f","Type":"ContainerStarted","Data":"226b2cbdb062ab1aed5c54029b19a9f2053bf28c6780e4e63887114261ba785d"}
Jul 30 20:21:33.950841 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.950800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal" event={"ID":"1c9dc975cd59a33670a37382999ae928","Type":"ContainerStarted","Data":"150c317eb3d643925823d95fe7ab4a0c50c3dd29f8130ce62ed3ed557946602a"}
Jul 30 20:21:33.951402 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.951343    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r4mzh" podStartSLOduration=2.124667263 podStartE2EDuration="21.951321646s" totalImagesPullingTime="19.826654383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:33.951145251 +0000 UTC m=+21.714065810" watchObservedRunningTime="2026-07-30 20:21:33.951321646 +0000 UTC m=+21.714242182"
Jul 30 20:21:33.964602 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.964542    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-180.ec2.internal" podStartSLOduration=20.964520772 podStartE2EDuration="20.964520772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:33.964441782 +0000 UTC m=+21.727362316" watchObservedRunningTime="2026-07-30 20:21:33.964520772 +0000 UTC m=+21.727441307"
Jul 30 20:21:33.981614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:33.981540    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t2m8t" podStartSLOduration=2.351240419 podStartE2EDuration="21.981524134s" totalImagesPullingTime="19.630283715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:33.98129428 +0000 UTC m=+21.744214816" watchObservedRunningTime="2026-07-30 20:21:33.981524134 +0000 UTC m=+21.744444665"
Jul 30 20:21:34.748338 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.748308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:34.748498 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:34.748411    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:34.956326 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.956285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"c908431baee7328799d342852a310f6f80b38decc6f4b1b93ef4769dc3a754dd"}
Jul 30 20:21:34.956568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.956388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"4dd915504551371e4eceaa5b4fb9039af5cbe6ff7447e9bc9275a4bb97b54505"}
Jul 30 20:21:34.956568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.956434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"82fe5e8052a8d6ee2dab8f09b5ecb5872cedd1f8338d8d33386918ecc3420d96"}
Jul 30 20:21:34.956568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.956478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"2471c237a0e6533832e90f85d08a7ddc464e8524e53b4d405b4865afc51f49b2"}
Jul 30 20:21:34.956568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.956523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"cb1e52aab6b5b803b815154ef9e7837e0703c48f9680b3b5e51f02f90e226396"}
Jul 30 20:21:34.957796 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.957763    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gl6w" event={"ID":"5e559ea1-db0c-4813-96d4-36fd94044e75","Type":"ContainerStarted","Data":"29d546e2f372f931271dcb92f7521d970bd292ecce052df8b4aec476d9e01f95"}
Jul 30 20:21:34.959526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.959500    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdnwm" event={"ID":"4f6653e8-4c5b-432e-b1a0-e7c84d86beca","Type":"ContainerStarted","Data":"488dbeeb98a0d1b72557e9010585844c52db5e639063228c1b25b2a843b11d68"}
Jul 30 20:21:34.961085 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.961057    2583 generic.go:356] "Generic (PLEG): container finished" podID="d45e1310fa5c8bfd9b22ddf2d48f7366" containerID="07e6f89ed2f2c5d02d3d7fb816aa277d3c0d941f6b8ba32105d6b8a824e4643b" exitCode=0
Jul 30 20:21:34.961184 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.961145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal" event={"ID":"d45e1310fa5c8bfd9b22ddf2d48f7366","Type":"ContainerDied","Data":"07e6f89ed2f2c5d02d3d7fb816aa277d3c0d941f6b8ba32105d6b8a824e4643b"}
Jul 30 20:21:34.962930 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.962905    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="c57eeeef7ff2c4f596bb5ffaa84ba8a1b1990e4138b8a79c2551ac7c86c302ce" exitCode=0
Jul 30 20:21:34.963045 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.962988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"c57eeeef7ff2c4f596bb5ffaa84ba8a1b1990e4138b8a79c2551ac7c86c302ce"}
Jul 30 20:21:34.964729 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.964708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp" event={"ID":"1a242a95-6640-447a-be01-a4c844d71db4","Type":"ContainerStarted","Data":"b1b2965b3e107a33b354bf3e1c28c876208ca36de80dba038d2781fd53b1479c"}
Jul 30 20:21:34.966228 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.966203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mbb46" event={"ID":"29a9a83d-67a7-4c58-ba77-2b3d3f083d36","Type":"ContainerStarted","Data":"d425ab66421d7c387ebde72ce68689d4c0f703488257d467d6d1a805d23c5481"}
Jul 30 20:21:34.973108 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:34.973068    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4gl6w" podStartSLOduration=6.724799298 podStartE2EDuration="21.973056317s" totalImagesPullingTime="15.248257019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:34.9728225 +0000 UTC m=+22.735743036" watchObservedRunningTime="2026-07-30 20:21:34.973056317 +0000 UTC m=+22.735976851"
Jul 30 20:21:35.018141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.017776    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cdnwm" podStartSLOduration=3.352955885 podStartE2EDuration="23.017754214s" totalImagesPullingTime="19.664798329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:35.002371181 +0000 UTC m=+22.765291716" watchObservedRunningTime="2026-07-30 20:21:35.017754214 +0000 UTC m=+22.780674749"
Jul 30 20:21:35.018298 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.018254    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mbb46" podStartSLOduration=3.409985873 podStartE2EDuration="23.018243253s" totalImagesPullingTime="19.60825738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:35.017500354 +0000 UTC m=+22.780420888" watchObservedRunningTime="2026-07-30 20:21:35.018243253 +0000 UTC m=+22.781163791"
Jul 30 20:21:35.493762 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.493723    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 20:21:35.678203 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.678052    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T20:21:35.493757156Z","UUID":"be02df64-8969-4c88-abc0-408e07bc3e1a","Handler":null,"Name":"","Endpoint":""}
Jul 30 20:21:35.679756 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.679733    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 20:21:35.679889 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.679774    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 20:21:35.748528 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.748500    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:35.749105 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:35.748622    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:35.749105 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.748678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:35.749105 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:35.748865    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:35.970635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.970550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sx9mh" event={"ID":"3f2dec94-5116-4659-b81d-12d6ceac798f","Type":"ContainerStarted","Data":"dc63130b46a8378d0146482fef3f4404d559e2576988366c59f16877377fc797"}
Jul 30 20:21:35.972851 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.972823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal" event={"ID":"d45e1310fa5c8bfd9b22ddf2d48f7366","Type":"ContainerStarted","Data":"fdd502e8ae974a69615059e444e9f299cb4ddb006beb3f0bb81940fa73dac426"}
Jul 30 20:21:35.975044 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.975020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp" event={"ID":"1a242a95-6640-447a-be01-a4c844d71db4","Type":"ContainerStarted","Data":"c1e0a177af5a0297c4b1f1449f51a299fa10969818f610aa56b58ad893fa980c"}
Jul 30 20:21:35.987208 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:35.987165    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sx9mh" podStartSLOduration=4.468166196 podStartE2EDuration="23.987152732s" totalImagesPullingTime="19.518986536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:35.98694813 +0000 UTC m=+23.749868665" watchObservedRunningTime="2026-07-30 20:21:35.987152732 +0000 UTC m=+23.750073267"
Jul 30 20:21:36.003593 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.003544    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-180.ec2.internal" podStartSLOduration=23.00352916 podStartE2EDuration="23.00352916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:36.002957862 +0000 UTC m=+23.765878396" watchObservedRunningTime="2026-07-30 20:21:36.00352916 +0000 UTC m=+23.766449693"
Jul 30 20:21:36.748564 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.748529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:36.749019 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:36.748659    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:36.794412 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.794380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdnwm_4f6653e8-4c5b-432e-b1a0-e7c84d86beca/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:36.891209 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.891161    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cdnwm_4f6653e8-4c5b-432e-b1a0-e7c84d86beca/konnectivity-agent/0.log" limit=1024
Jul 30 20:21:36.979400 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.979349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp" event={"ID":"1a242a95-6640-447a-be01-a4c844d71db4","Type":"ContainerStarted","Data":"07a4aba070abbbdfb8d034ae0bbaeff16047df6a33ee281afc15ff72960a8d5e"}
Jul 30 20:21:36.983360 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.982950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"d07ea023a6a7f350ce43cb8ce5fbc486223e32fcd56db217145a99dfd83ccaf7"}
Jul 30 20:21:36.997930 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:36.997880    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlpzp" podStartSLOduration=7.444763461 podStartE2EDuration="24.997863621s" totalImagesPullingTime="17.55310016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:36.997072174 +0000 UTC m=+24.759992708" watchObservedRunningTime="2026-07-30 20:21:36.997863621 +0000 UTC m=+24.760784154"
Jul 30 20:21:37.747458 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:37.747423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:37.747661 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:37.747548    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:37.747661 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:37.747609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:37.747791 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:37.747748    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:38.108598 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:38.108524    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:38.109224 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:38.109205    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:38.747861 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:38.747825    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:38.748036 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:38.747935    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:38.987486 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:38.987457    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:38.987990 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:38.987969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cdnwm"
Jul 30 20:21:39.747907 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:39.747739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:39.748413 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:39.747737    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:39.748413 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:39.748003    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:39.748413 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:39.748059    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:39.990478 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:39.990448    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="b80774502c1fafb95fbeec8a0243a8d070199438a0c5aeee56f7e1c10613fcc9" exitCode=0
Jul 30 20:21:39.990649 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:39.990538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"b80774502c1fafb95fbeec8a0243a8d070199438a0c5aeee56f7e1c10613fcc9"}
Jul 30 20:21:39.994197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:39.994166    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" event={"ID":"a2086f96-b861-4fdd-b126-c5c1b58fbac3","Type":"ContainerStarted","Data":"3bd5c6f2b915968eac87ace1bd5324389866258485608636bf045b7a2f8493e5"}
Jul 30 20:21:40.037326 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.037244    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9" podStartSLOduration=8.338279777 podStartE2EDuration="28.037229165s" totalImagesPullingTime="19.698949388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:40.037150213 +0000 UTC m=+27.800070746" watchObservedRunningTime="2026-07-30 20:21:40.037229165 +0000 UTC m=+27.800149698"
Jul 30 20:21:40.747876 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.747845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:40.748086 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:40.747999    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:40.999219 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.999023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerStarted","Data":"c357fe605cce88a2289ce019fa0c6fef2f77a46dda4d4f709bf1563a0f3d4b0e"}
Jul 30 20:21:40.999801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.999775    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:40.999915 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.999853    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:40.999915 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:40.999901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:41.015148 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.015117    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:41.019087 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.019066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:21:41.138788 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.138672    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9vtn"]
Jul 30 20:21:41.138964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.138820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:41.138964 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:41.138938    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:41.141932 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.141904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wpprs"]
Jul 30 20:21:41.142079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.142008    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:41.142132 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:41.142103    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:41.142978 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.142836    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8v5lt"]
Jul 30 20:21:41.142978 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:41.142937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:41.143148 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:41.143021    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:42.003560 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:42.003526    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="c357fe605cce88a2289ce019fa0c6fef2f77a46dda4d4f709bf1563a0f3d4b0e" exitCode=0
Jul 30 20:21:42.004128 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:42.003601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"c357fe605cce88a2289ce019fa0c6fef2f77a46dda4d4f709bf1563a0f3d4b0e"}
Jul 30 20:21:42.749410 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:42.749372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:42.749574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:42.749466    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:42.749574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:42.749516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:42.749574 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:42.749533    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:42.749752 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:42.749602    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:42.749752 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:42.749720    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:43.008651 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:43.008614    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerStarted","Data":"681b5af917f39b0690df17e6c18c59103320ce6affb48c5e92cdf4b175279373"}
Jul 30 20:21:44.012897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:44.012866    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="681b5af917f39b0690df17e6c18c59103320ce6affb48c5e92cdf4b175279373" exitCode=0
Jul 30 20:21:44.013264 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:44.012908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"681b5af917f39b0690df17e6c18c59103320ce6affb48c5e92cdf4b175279373"}
Jul 30 20:21:44.748226 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:44.748145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:44.748226 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:44.748165    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:44.748475 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:44.748265    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:44.748475 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:44.748280    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wpprs" podUID="ee134adb-7f74-4f68-93da-b104a529afe5"
Jul 30 20:21:44.748475 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:44.748377    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9vtn" podUID="21c16074-1a8f-4b64-928f-97d5d546fa1f"
Jul 30 20:21:44.748475 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:44.748456    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8v5lt" podUID="83b7df1b-3a67-452f-b7cf-1b40fae23455"
Jul 30 20:21:45.465814 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:45.465555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:45.466255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:45.465844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:45.466255 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.465724    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:45.466255 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.465968    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:45.466255 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.465991    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs podName:83b7df1b-3a67-452f-b7cf-1b40fae23455 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:17.465961695 +0000 UTC m=+65.228882215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs") pod "network-metrics-daemon-8v5lt" (UID: "83b7df1b-3a67-452f-b7cf-1b40fae23455") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 20:21:45.466255 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.466015    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret podName:21c16074-1a8f-4b64-928f-97d5d546fa1f nodeName:}" failed. No retries permitted until 2026-07-30 20:22:17.466004197 +0000 UTC m=+65.228924709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret") pod "global-pull-secret-syncer-x9vtn" (UID: "21c16074-1a8f-4b64-928f-97d5d546fa1f") : object "kube-system"/"original-pull-secret" not registered
Jul 30 20:21:45.567202 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:45.567169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:45.567385 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.567296    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 20:21:45.567385 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.567312    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 20:21:45.567385 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.567321    2583 projected.go:196] Error preparing data for projected volume kube-api-access-shczv for pod openshift-network-diagnostics/network-check-target-wpprs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:45.567385 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:45.567376    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv podName:ee134adb-7f74-4f68-93da-b104a529afe5 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:17.56735905 +0000 UTC m=+65.330279576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-shczv" (UniqueName: "kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv") pod "network-check-target-wpprs" (UID: "ee134adb-7f74-4f68-93da-b104a529afe5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 20:21:46.593444 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.593415    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-180.ec2.internal" event="NodeReady"
Jul 30 20:21:46.593863 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.593558    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 20:21:46.655675 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.655639    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:21:46.658040 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.658014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.661389 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.661356    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 20:21:46.661591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.661433    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 20:21:46.668370 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.668345    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q4l4z\""
Jul 30 20:21:46.670700 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.670666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 20:21:46.671149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.671110    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 20:21:46.672118 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.672100    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zkll7"]
Jul 30 20:21:46.674096 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.674078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.675448 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.675430    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kqt2h"]
Jul 30 20:21:46.676800 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.676757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 20:21:46.676947 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.676865    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nmld7\""
Jul 30 20:21:46.677162 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.677143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.677264 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.677203    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 20:21:46.679887 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.679867    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 20:21:46.679991 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.679868    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 20:21:46.680406 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.680366    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 20:21:46.680703 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.680671    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7hfpr\""
Jul 30 20:21:46.686175 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.686151    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:21:46.699100 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.698908    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kqt2h"]
Jul 30 20:21:46.707365 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.707336    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkll7"]
Jul 30 20:21:46.747994 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.747958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:21:46.748887 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.748770    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:21:46.749823 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.749801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:21:46.751918 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.751731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:21:46.752112 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.752092    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jh8wl\""
Jul 30 20:21:46.752219 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.752097    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:21:46.752877 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.752661    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:21:46.752877 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.752775    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qz5l\""
Jul 30 20:21:46.753010 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.752897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:21:46.776834 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.776955 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38538573-aa76-47d4-aea1-202c0de74b98-tmp-dir\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.776955 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqsrz\" (UniqueName: \"kubernetes.io/projected/4ed9e975-9725-4bad-a81b-31303769bf58-kube-api-access-gqsrz\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.776955 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ed9e975-9725-4bad-a81b-31303769bf58-cert\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.777131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.776978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt6pv\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.777294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38538573-aa76-47d4-aea1-202c0de74b98-config-volume\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.777431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.777431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.777339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69l6\" (UniqueName: \"kubernetes.io/projected/38538573-aa76-47d4-aea1-202c0de74b98-kube-api-access-p69l6\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.877957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.877862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38538573-aa76-47d4-aea1-202c0de74b98-config-volume\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.877957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.877906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.877957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.877955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p69l6\" (UniqueName: \"kubernetes.io/projected/38538573-aa76-47d4-aea1-202c0de74b98-kube-api-access-p69l6\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.877977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.877997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38538573-aa76-47d4-aea1-202c0de74b98-tmp-dir\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqsrz\" (UniqueName: \"kubernetes.io/projected/4ed9e975-9725-4bad-a81b-31303769bf58-kube-api-access-gqsrz\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ed9e975-9725-4bad-a81b-31303769bf58-cert\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt6pv\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.878484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/38538573-aa76-47d4-aea1-202c0de74b98-tmp-dir\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.878567 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/38538573-aa76-47d4-aea1-202c0de74b98-config-volume\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.878643 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:46.878618    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:21:46.878746 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.878656    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.879183 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.879157    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.879471 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:46.879453    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:21:46.879471 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:46.879472    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb47856c6-58xmp: secret "image-registry-tls" not found
Jul 30 20:21:46.879638 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.879522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.879638 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:46.879588    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls podName:38538573-aa76-47d4-aea1-202c0de74b98 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:47.378681412 +0000 UTC m=+35.141601927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls") pod "dns-default-zkll7" (UID: "38538573-aa76-47d4-aea1-202c0de74b98") : secret "dns-default-metrics-tls" not found
Jul 30 20:21:46.879638 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:46.879611    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls podName:b398ddb8-8651-44f9-913d-0219f1bd6bd4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:47.379602034 +0000 UTC m=+35.142522575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls") pod "image-registry-bb47856c6-58xmp" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4") : secret "image-registry-tls" not found
Jul 30 20:21:46.883012 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.882982    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.883012 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.883001    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.883181 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.883061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ed9e975-9725-4bad-a81b-31303769bf58-cert\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.888953 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.888914    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69l6\" (UniqueName: \"kubernetes.io/projected/38538573-aa76-47d4-aea1-202c0de74b98-kube-api-access-p69l6\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:46.889060 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.889024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqsrz\" (UniqueName: \"kubernetes.io/projected/4ed9e975-9725-4bad-a81b-31303769bf58-kube-api-access-gqsrz\") pod \"ingress-canary-kqt2h\" (UID: \"4ed9e975-9725-4bad-a81b-31303769bf58\") " pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:46.889270 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.889251    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.889386 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.889363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt6pv\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:46.992054 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:46.992016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kqt2h"
Jul 30 20:21:47.076364 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.076325    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nhzv2"]
Jul 30 20:21:47.078334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.078312    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.080981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.080961    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 20:21:47.081568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.081547    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 20:21:47.081568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.081550    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 20:21:47.081874 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.081846    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9q9km\""
Jul 30 20:21:47.082079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.082062    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 20:21:47.092979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.092955    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhzv2"]
Jul 30 20:21:47.101796 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.101775    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"]
Jul 30 20:21:47.103466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.103451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.106370 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.106348    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 30 20:21:47.106596 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.106582    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8x29d\""
Jul 30 20:21:47.107349 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.107330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 30 20:21:47.120619 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.120594    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"]
Jul 30 20:21:47.180890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.180814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.180890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.180851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7124637-e339-447e-9a13-b5d23232dfb4-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.180890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.180881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.181159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.180946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/027f733c-9659-4d3b-9493-f986c8fd8d76-crio-socket\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.181159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.181004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-846j6\" (UniqueName: \"kubernetes.io/projected/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-api-access-846j6\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.181159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.181045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/027f733c-9659-4d3b-9493-f986c8fd8d76-data-volume\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.181159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.181078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.281899 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.281866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/027f733c-9659-4d3b-9493-f986c8fd8d76-crio-socket\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282068 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.281912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-846j6\" (UniqueName: \"kubernetes.io/projected/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-api-access-846j6\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282068 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/027f733c-9659-4d3b-9493-f986c8fd8d76-data-volume\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282177 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282063    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.282177 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282177 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7124637-e339-447e-9a13-b5d23232dfb4-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.282310 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/027f733c-9659-4d3b-9493-f986c8fd8d76-crio-socket\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282310 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.282310 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282282    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:47.282442 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282317    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:21:47.282442 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282339    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:47.782320624 +0000 UTC m=+35.545241136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:47.282442 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282367    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:47.78235088 +0000 UTC m=+35.545271394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:21:47.282632 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282611    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:21:47.282778 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.282664    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:47.782648186 +0000 UTC m=+35.545568699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : configmap "kube-rbac-proxy" not found
Jul 30 20:21:47.282778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.282737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/027f733c-9659-4d3b-9493-f986c8fd8d76-data-volume\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.283122 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.283094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c7124637-e339-447e-9a13-b5d23232dfb4-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.292915 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.292866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-846j6\" (UniqueName: \"kubernetes.io/projected/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-api-access-846j6\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.382859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.382821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:47.383031 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.382906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:47.383031 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.382971    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:21:47.383148 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.383047    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls podName:38538573-aa76-47d4-aea1-202c0de74b98 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:48.383026067 +0000 UTC m=+36.145946627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls") pod "dns-default-zkll7" (UID: "38538573-aa76-47d4-aea1-202c0de74b98") : secret "dns-default-metrics-tls" not found
Jul 30 20:21:47.383148 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.383068    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:21:47.383148 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.383088    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb47856c6-58xmp: secret "image-registry-tls" not found
Jul 30 20:21:47.383296 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.383157    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls podName:b398ddb8-8651-44f9-913d-0219f1bd6bd4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:48.383138686 +0000 UTC m=+36.146059212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls") pod "image-registry-bb47856c6-58xmp" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4") : secret "image-registry-tls" not found
Jul 30 20:21:47.785707 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.785657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.785746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785803    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785829    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.785855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785867    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:48.785848939 +0000 UTC m=+36.548769452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785934    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785939    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:48.78591398 +0000 UTC m=+36.548834497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : configmap "kube-rbac-proxy" not found
Jul 30 20:21:47.786287 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:47.785973    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:48.785960697 +0000 UTC m=+36.548881209 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:47.938704 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:47.938457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kqt2h"]
Jul 30 20:21:47.942808 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:21:47.942782    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed9e975_9725_4bad_a81b_31303769bf58.slice/crio-e4872d5bb6a2ba058f62e5e5812a6b1ff86b613c02e6a4fe6650b2ea2229867d WatchSource:0}: Error finding container e4872d5bb6a2ba058f62e5e5812a6b1ff86b613c02e6a4fe6650b2ea2229867d: Status 404 returned error can't find the container with id e4872d5bb6a2ba058f62e5e5812a6b1ff86b613c02e6a4fe6650b2ea2229867d
Jul 30 20:21:48.024374 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.024341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kqt2h" event={"ID":"4ed9e975-9725-4bad-a81b-31303769bf58","Type":"ContainerStarted","Data":"e4872d5bb6a2ba058f62e5e5812a6b1ff86b613c02e6a4fe6650b2ea2229867d"}
Jul 30 20:21:48.027229 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.027197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerStarted","Data":"7a7a44c863ddefeaff7fd7b217af96eb4ecbd257c44dd87f540990e74424f42f"}
Jul 30 20:21:48.391325 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.391293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:48.391558 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.391363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:48.391558 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.391446    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:21:48.391558 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.391451    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:21:48.391558 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.391522    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb47856c6-58xmp: secret "image-registry-tls" not found
Jul 30 20:21:48.391558 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.391503    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls podName:38538573-aa76-47d4-aea1-202c0de74b98 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:50.391489652 +0000 UTC m=+38.154410165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls") pod "dns-default-zkll7" (UID: "38538573-aa76-47d4-aea1-202c0de74b98") : secret "dns-default-metrics-tls" not found
Jul 30 20:21:48.391776 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.391620    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls podName:b398ddb8-8651-44f9-913d-0219f1bd6bd4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:50.391608673 +0000 UTC m=+38.154529185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls") pod "image-registry-bb47856c6-58xmp" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4") : secret "image-registry-tls" not found
Jul 30 20:21:48.795069 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.795026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.795116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:48.795154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795224    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795253    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795307    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:50.795287219 +0000 UTC m=+38.558207737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795330    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:50.795318412 +0000 UTC m=+38.558238927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : configmap "kube-rbac-proxy" not found
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795373    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:48.795744 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:48.795423    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:50.795409548 +0000 UTC m=+38.558330061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:49.033216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:49.033158    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="7a7a44c863ddefeaff7fd7b217af96eb4ecbd257c44dd87f540990e74424f42f" exitCode=0
Jul 30 20:21:49.033369 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:49.033239    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"7a7a44c863ddefeaff7fd7b217af96eb4ecbd257c44dd87f540990e74424f42f"}
Jul 30 20:21:49.438048 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:49.437966    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gl6w_5e559ea1-db0c-4813-96d4-36fd94044e75/dns-node-resolver/0.log"
Jul 30 20:21:50.038537 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.038509    2583 generic.go:356] "Generic (PLEG): container finished" podID="8fbc0d92-e937-4036-a986-5fb00541214b" containerID="404b85745d28d25342b59e4d28823d9f7ba472844d285313ac328df04066bd3e" exitCode=0
Jul 30 20:21:50.038905 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.038568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerDied","Data":"404b85745d28d25342b59e4d28823d9f7ba472844d285313ac328df04066bd3e"}
Jul 30 20:21:50.408025 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.407998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:50.408098 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.408082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:50.408180 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.408136    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:21:50.408213 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.408196    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls podName:38538573-aa76-47d4-aea1-202c0de74b98 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:54.408181755 +0000 UTC m=+42.171102267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls") pod "dns-default-zkll7" (UID: "38538573-aa76-47d4-aea1-202c0de74b98") : secret "dns-default-metrics-tls" not found
Jul 30 20:21:50.408254 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.408237    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:21:50.408254 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.408250    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb47856c6-58xmp: secret "image-registry-tls" not found
Jul 30 20:21:50.408308 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.408297    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls podName:b398ddb8-8651-44f9-913d-0219f1bd6bd4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:54.408280697 +0000 UTC m=+42.171201208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls") pod "image-registry-bb47856c6-58xmp" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4") : secret "image-registry-tls" not found
Jul 30 20:21:50.638376 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.638302    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mbb46_29a9a83d-67a7-4c58-ba77-2b3d3f083d36/node-ca/0.log"
Jul 30 20:21:50.810792 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.810747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:50.810792 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.810797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.810858    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.810901    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.810912    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:54.810891868 +0000 UTC m=+42.573812381 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : configmap "kube-rbac-proxy" not found
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:50.810978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.810990    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:54.810970022 +0000 UTC m=+42.573890535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:21:50.811044 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.811026    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:50.811382 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:50.811056    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:21:54.811046861 +0000 UTC m=+42.573967373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:51.042509 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:51.042477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kqt2h" event={"ID":"4ed9e975-9725-4bad-a81b-31303769bf58","Type":"ContainerStarted","Data":"db2e2b37d4162ed4407dfa24852007156a2dcdde2cdfd05124a185aba9aae02f"}
Jul 30 20:21:51.045620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:51.045592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" event={"ID":"8fbc0d92-e937-4036-a986-5fb00541214b","Type":"ContainerStarted","Data":"1e37611d45f8f70bc33417beea5a8ee26041a57e90f140bdb2e12068f1fd9b38"}
Jul 30 20:21:51.060537 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:51.060492    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kqt2h" podStartSLOduration=2.61839503 podStartE2EDuration="5.06047645s" totalImagesPullingTime="2.44208142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:51.059297536 +0000 UTC m=+38.822218070" watchObservedRunningTime="2026-07-30 20:21:51.06047645 +0000 UTC m=+38.823397048"
Jul 30 20:21:51.084733 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:51.083876    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rjrvx" podStartSLOduration=8.835431978 podStartE2EDuration="38.083856552s" totalImagesPullingTime="29.248424574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:21:51.08297593 +0000 UTC m=+38.845896479" watchObservedRunningTime="2026-07-30 20:21:51.083856552 +0000 UTC m=+38.846777100"
Jul 30 20:21:54.442495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.442451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.442559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.442632    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.442651    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.442744    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls podName:38538573-aa76-47d4-aea1-202c0de74b98 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:02.442731225 +0000 UTC m=+50.205651737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls") pod "dns-default-zkll7" (UID: "38538573-aa76-47d4-aea1-202c0de74b98") : secret "dns-default-metrics-tls" not found
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.442658    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-bb47856c6-58xmp: secret "image-registry-tls" not found
Jul 30 20:21:54.443005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.442778    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls podName:b398ddb8-8651-44f9-913d-0219f1bd6bd4 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:02.442772593 +0000 UTC m=+50.205693105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls") pod "image-registry-bb47856c6-58xmp" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4") : secret "image-registry-tls" not found
Jul 30 20:21:54.845946 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.845906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:21:54.846140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.845965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:54.846140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.846000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:21:54.846140 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.846074    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:21:54.846140 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.846123    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:54.846339 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.846154    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:02.846131662 +0000 UTC m=+50.609052188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:21:54.846339 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:21:54.846176    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls podName:027f733c-9659-4d3b-9493-f986c8fd8d76 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:02.846161865 +0000 UTC m=+50.609082406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nhzv2" (UID: "027f733c-9659-4d3b-9493-f986c8fd8d76") : secret "insights-runtime-extractor-tls" not found
Jul 30 20:21:54.846517 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:21:54.846497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/027f733c-9659-4d3b-9493-f986c8fd8d76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:22:02.500911 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.500871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:22:02.501413 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.500955    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:02.504736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.504710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/38538573-aa76-47d4-aea1-202c0de74b98-metrics-tls\") pod \"dns-default-zkll7\" (UID: \"38538573-aa76-47d4-aea1-202c0de74b98\") " pod="openshift-dns/dns-default-zkll7"
Jul 30 20:22:02.505059 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.505039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"image-registry-bb47856c6-58xmp\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") " pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:02.569509 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.569468    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:02.584846 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.584827    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkll7"
Jul 30 20:22:02.729842 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.729804    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:22:02.734188 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.734107    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkll7"]
Jul 30 20:22:02.735199 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:02.735096    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb398ddb8_8651_44f9_913d_0219f1bd6bd4.slice/crio-bdbd13aac65a1089a08198d952408a0a4a4f1bd3acf513603f3b56d0fa8188be WatchSource:0}: Error finding container bdbd13aac65a1089a08198d952408a0a4a4f1bd3acf513603f3b56d0fa8188be: Status 404 returned error can't find the container with id bdbd13aac65a1089a08198d952408a0a4a4f1bd3acf513603f3b56d0fa8188be
Jul 30 20:22:02.737464 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:02.737441    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38538573_aa76_47d4_aea1_202c0de74b98.slice/crio-5a7c649478e8ccd40a59b2c5418d055e83e471f065497b5f4db4f63a15e9196e WatchSource:0}: Error finding container 5a7c649478e8ccd40a59b2c5418d055e83e471f065497b5f4db4f63a15e9196e: Status 404 returned error can't find the container with id 5a7c649478e8ccd40a59b2c5418d055e83e471f065497b5f4db4f63a15e9196e
Jul 30 20:22:02.905534 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.905495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:22:02.905754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.905553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:22:02.905754 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:02.905653    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 30 20:22:02.905754 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:02.905752    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert podName:c7124637-e339-447e-9a13-b5d23232dfb4 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:18.905730648 +0000 UTC m=+66.668651160 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-r58hb" (UID: "c7124637-e339-447e-9a13-b5d23232dfb4") : secret "networking-console-plugin-cert" not found
Jul 30 20:22:02.907781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.907757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/027f733c-9659-4d3b-9493-f986c8fd8d76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nhzv2\" (UID: \"027f733c-9659-4d3b-9493-f986c8fd8d76\") " pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:22:02.990164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:02.990129    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nhzv2"
Jul 30 20:22:03.071365 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.071330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" event={"ID":"b398ddb8-8651-44f9-913d-0219f1bd6bd4","Type":"ContainerStarted","Data":"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"}
Jul 30 20:22:03.071556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.071391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" event={"ID":"b398ddb8-8651-44f9-913d-0219f1bd6bd4","Type":"ContainerStarted","Data":"bdbd13aac65a1089a08198d952408a0a4a4f1bd3acf513603f3b56d0fa8188be"}
Jul 30 20:22:03.071556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.071419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:03.072386 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.072355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkll7" event={"ID":"38538573-aa76-47d4-aea1-202c0de74b98","Type":"ContainerStarted","Data":"5a7c649478e8ccd40a59b2c5418d055e83e471f065497b5f4db4f63a15e9196e"}
Jul 30 20:22:03.092107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.092056    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" podStartSLOduration=41.092037868 podStartE2EDuration="41.092037868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:03.091445602 +0000 UTC m=+50.854366137" watchObservedRunningTime="2026-07-30 20:22:03.092037868 +0000 UTC m=+50.854958430"
Jul 30 20:22:03.128056 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:03.127970    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nhzv2"]
Jul 30 20:22:03.132411 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:03.132376    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027f733c_9659_4d3b_9493_f986c8fd8d76.slice/crio-7a22857789738c59badb60009a3ab59cb6af59d47b811dd109a47a5d933d7dd0 WatchSource:0}: Error finding container 7a22857789738c59badb60009a3ab59cb6af59d47b811dd109a47a5d933d7dd0: Status 404 returned error can't find the container with id 7a22857789738c59badb60009a3ab59cb6af59d47b811dd109a47a5d933d7dd0
Jul 30 20:22:04.079562 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:04.079528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhzv2" event={"ID":"027f733c-9659-4d3b-9493-f986c8fd8d76","Type":"ContainerStarted","Data":"de72fa6dc0d31c5c0b0a9ceb9d3bba99169b9edf74c1f344932c62d8498a580a"}
Jul 30 20:22:04.079985 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:04.079617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhzv2" event={"ID":"027f733c-9659-4d3b-9493-f986c8fd8d76","Type":"ContainerStarted","Data":"7a22857789738c59badb60009a3ab59cb6af59d47b811dd109a47a5d933d7dd0"}
Jul 30 20:22:06.087834 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:06.087793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkll7" event={"ID":"38538573-aa76-47d4-aea1-202c0de74b98","Type":"ContainerStarted","Data":"3cc5872375d9bc9c64089d58cfc906bff19d36ac053d61749fefa84b4c7367ef"}
Jul 30 20:22:06.088356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:06.087855    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkll7" event={"ID":"38538573-aa76-47d4-aea1-202c0de74b98","Type":"ContainerStarted","Data":"ea5d884e437f12717e25e4220dac44468e56410388ec15188f27fbc639ca53d9"}
Jul 30 20:22:06.088356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:06.087912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zkll7"
Jul 30 20:22:06.090021 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:06.089998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhzv2" event={"ID":"027f733c-9659-4d3b-9493-f986c8fd8d76","Type":"ContainerStarted","Data":"c48e70641bcc3ae5e074e16d389bd30bb47d83d674674b62401028adf3e2ef88"}
Jul 30 20:22:06.106397 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:06.106340    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zkll7" podStartSLOduration=17.894359124 podStartE2EDuration="20.106317908s" totalImagesPullingTime="2.211958784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:06.105769457 +0000 UTC m=+53.868689994" watchObservedRunningTime="2026-07-30 20:22:06.106317908 +0000 UTC m=+53.869238443"
Jul 30 20:22:07.098279 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:07.098230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nhzv2" event={"ID":"027f733c-9659-4d3b-9493-f986c8fd8d76","Type":"ContainerStarted","Data":"f8584e486df8868a62fd84033b4adb427eb5feeab286556ff0abc7de1f577a2d"}
Jul 30 20:22:07.118323 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:07.118269    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nhzv2" podStartSLOduration=17.144858077 podStartE2EDuration="20.118254922s" totalImagesPullingTime="2.973396845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:07.116542098 +0000 UTC m=+54.879462633" watchObservedRunningTime="2026-07-30 20:22:07.118254922 +0000 UTC m=+54.881175456"
Jul 30 20:22:09.033556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.033519    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"]
Jul 30 20:22:09.036302 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.036286    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.040168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.040141    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 20:22:09.040423 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.040400    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 20:22:09.041500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.041481    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 30 20:22:09.043170 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.043153    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 20:22:09.058233 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.058212    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"]
Jul 30 20:22:09.058404 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.058382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e99f931-12df-4eac-9588-34c72a78610b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.058494 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.058421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e99f931-12df-4eac-9588-34c72a78610b-tmp\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.058560 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.058540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rx4s\" (UniqueName: \"kubernetes.io/projected/7e99f931-12df-4eac-9588-34c72a78610b-kube-api-access-2rx4s\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.159516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.159478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rx4s\" (UniqueName: \"kubernetes.io/projected/7e99f931-12df-4eac-9588-34c72a78610b-kube-api-access-2rx4s\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.159711 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.159536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e99f931-12df-4eac-9588-34c72a78610b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.159765 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.159727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e99f931-12df-4eac-9588-34c72a78610b-tmp\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.160058 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.160039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e99f931-12df-4eac-9588-34c72a78610b-tmp\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.161954 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.161932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7e99f931-12df-4eac-9588-34c72a78610b-klusterlet-config\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.180959 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.180927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rx4s\" (UniqueName: \"kubernetes.io/projected/7e99f931-12df-4eac-9588-34c72a78610b-kube-api-access-2rx4s\") pod \"klusterlet-addon-workmgr-7dbd4976fd-nmzw2\" (UID: \"7e99f931-12df-4eac-9588-34c72a78610b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.345390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.345296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:09.468244 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:09.468214    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"]
Jul 30 20:22:09.471231 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:09.471188    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e99f931_12df_4eac_9588_34c72a78610b.slice/crio-4eccf62c70a98a590b1ca67ffc794f5144ec620c70f97455736f52df121bc562 WatchSource:0}: Error finding container 4eccf62c70a98a590b1ca67ffc794f5144ec620c70f97455736f52df121bc562: Status 404 returned error can't find the container with id 4eccf62c70a98a590b1ca67ffc794f5144ec620c70f97455736f52df121bc562
Jul 30 20:22:10.109249 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:10.109213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2" event={"ID":"7e99f931-12df-4eac-9588-34c72a78610b","Type":"ContainerStarted","Data":"4eccf62c70a98a590b1ca67ffc794f5144ec620c70f97455736f52df121bc562"}
Jul 30 20:22:13.025156 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:13.025123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwtt9"
Jul 30 20:22:14.123331 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:14.123286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2" event={"ID":"7e99f931-12df-4eac-9588-34c72a78610b","Type":"ContainerStarted","Data":"2676ede896b35ebc54424c9d69fa1f43b009e256d15ba8f2568f78e907bb26ed"}
Jul 30 20:22:14.123757 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:14.123534    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:14.125313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:14.125288    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2"
Jul 30 20:22:14.140509 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:14.140466    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7dbd4976fd-nmzw2" podStartSLOduration=1.189716362 podStartE2EDuration="5.140451295s" totalImagesPullingTime="3.950734933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:14.139992858 +0000 UTC m=+61.902913393" watchObservedRunningTime="2026-07-30 20:22:14.140451295 +0000 UTC m=+61.903371820"
Jul 30 20:22:15.289280 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.289242    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"]
Jul 30 20:22:15.291267 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.291244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:15.293746 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.293723    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 30 20:22:15.293851 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.293791    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xw6z8\""
Jul 30 20:22:15.300096 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.300075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"]
Jul 30 20:22:15.412884 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.412845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb8b3188-3c0f-4ef0-837b-5220de22f565-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-fmj7f\" (UID: \"cb8b3188-3c0f-4ef0-837b-5220de22f565\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:15.513812 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.513778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb8b3188-3c0f-4ef0-837b-5220de22f565-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-fmj7f\" (UID: \"cb8b3188-3c0f-4ef0-837b-5220de22f565\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:15.516374 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.516345    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb8b3188-3c0f-4ef0-837b-5220de22f565-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-fmj7f\" (UID: \"cb8b3188-3c0f-4ef0-837b-5220de22f565\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:15.600123 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.600029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:15.723794 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:15.723764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"]
Jul 30 20:22:15.726826 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:15.726799    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8b3188_3c0f_4ef0_837b_5220de22f565.slice/crio-414811bbb6caf43878972c414dd1f6052a7720d640a9fe18f25d8fb3eee233d5 WatchSource:0}: Error finding container 414811bbb6caf43878972c414dd1f6052a7720d640a9fe18f25d8fb3eee233d5: Status 404 returned error can't find the container with id 414811bbb6caf43878972c414dd1f6052a7720d640a9fe18f25d8fb3eee233d5
Jul 30 20:22:16.100230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:16.100201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zkll7"
Jul 30 20:22:16.131134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:16.131093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f" event={"ID":"cb8b3188-3c0f-4ef0-837b-5220de22f565","Type":"ContainerStarted","Data":"414811bbb6caf43878972c414dd1f6052a7720d640a9fe18f25d8fb3eee233d5"}
Jul 30 20:22:17.135441 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.135407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f" event={"ID":"cb8b3188-3c0f-4ef0-837b-5220de22f565","Type":"ContainerStarted","Data":"4f65c3237f91788f9710ece0affe6e6e14560c9fc23fc1fa37b30e3ac1ecbb27"}
Jul 30 20:22:17.135914 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.135624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:17.140263 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.140239    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f"
Jul 30 20:22:17.201899 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.201847    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-fmj7f" podStartSLOduration=1.331291193 podStartE2EDuration="2.201828059s" totalImagesPullingTime="870.536866ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:17.167275659 +0000 UTC m=+64.930196193" watchObservedRunningTime="2026-07-30 20:22:17.201828059 +0000 UTC m=+64.964748594"
Jul 30 20:22:17.356190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.356158    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"]
Jul 30 20:22:17.358138 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.358122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.360859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.360829    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 20:22:17.361030 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.361011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 20:22:17.361107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.361054    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 20:22:17.361107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.361068    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jv6fq\""
Jul 30 20:22:17.361107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.361011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 20:22:17.361107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.361010    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 20:22:17.368558 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.368535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"]
Jul 30 20:22:17.430972 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.430883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.430972 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.430965    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0df97c4-d860-44b6-8c57-02bc64a114b1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.431158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.431090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.431158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.431126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmcm\" (UniqueName: \"kubernetes.io/projected/b0df97c4-d860-44b6-8c57-02bc64a114b1-kube-api-access-hjmcm\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.532154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.532327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:22:17.532327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:22:17.532327 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:17.532266    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 30 20:22:17.532327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0df97c4-d860-44b6-8c57-02bc64a114b1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.532548 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:17.532334    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls podName:b0df97c4-d860-44b6-8c57-02bc64a114b1 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:18.032318133 +0000 UTC m=+65.795238646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-6gdgf" (UID: "b0df97c4-d860-44b6-8c57-02bc64a114b1") : secret "prometheus-operator-tls" not found
Jul 30 20:22:17.532548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532378    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.532548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmcm\" (UniqueName: \"kubernetes.io/projected/b0df97c4-d860-44b6-8c57-02bc64a114b1-kube-api-access-hjmcm\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.532980 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.532962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0df97c4-d860-44b6-8c57-02bc64a114b1-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.534782 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.534751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.534920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.534851    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 20:22:17.534920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.534887    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 20:22:17.543581 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.543553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmcm\" (UniqueName: \"kubernetes.io/projected/b0df97c4-d860-44b6-8c57-02bc64a114b1-kube-api-access-hjmcm\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:17.544529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.544512    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21c16074-1a8f-4b64-928f-97d5d546fa1f-original-pull-secret\") pod \"global-pull-secret-syncer-x9vtn\" (UID: \"21c16074-1a8f-4b64-928f-97d5d546fa1f\") " pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:22:17.544751 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.544731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83b7df1b-3a67-452f-b7cf-1b40fae23455-metrics-certs\") pod \"network-metrics-daemon-8v5lt\" (UID: \"83b7df1b-3a67-452f-b7cf-1b40fae23455\") " pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:22:17.633482 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.633446    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:22:17.636101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.636083    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 20:22:17.646748 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.646721    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 20:22:17.657298 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.657270    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shczv\" (UniqueName: \"kubernetes.io/projected/ee134adb-7f74-4f68-93da-b104a529afe5-kube-api-access-shczv\") pod \"network-check-target-wpprs\" (UID: \"ee134adb-7f74-4f68-93da-b104a529afe5\") " pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:22:17.663083 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.663060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9vtn"
Jul 30 20:22:17.673108 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.673076    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jh8wl\""
Jul 30 20:22:17.678785 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.678765    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4qz5l\""
Jul 30 20:22:17.680614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.680597    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:22:17.686457 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.686433    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8v5lt"
Jul 30 20:22:17.808921 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:17.808890    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c16074_1a8f_4b64_928f_97d5d546fa1f.slice/crio-3425256a28513e351fc7f1614d46a051fff5396dbf70dc94d77a0bc661dae393 WatchSource:0}: Error finding container 3425256a28513e351fc7f1614d46a051fff5396dbf70dc94d77a0bc661dae393: Status 404 returned error can't find the container with id 3425256a28513e351fc7f1614d46a051fff5396dbf70dc94d77a0bc661dae393
Jul 30 20:22:17.809614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.809593    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9vtn"]
Jul 30 20:22:17.827022 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.826996    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wpprs"]
Jul 30 20:22:17.830178 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:17.830142    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee134adb_7f74_4f68_93da_b104a529afe5.slice/crio-ed3abd8b724b0a31f38405d33e1ed69e366ba46825561a30e6b9faac72cfa034 WatchSource:0}: Error finding container ed3abd8b724b0a31f38405d33e1ed69e366ba46825561a30e6b9faac72cfa034: Status 404 returned error can't find the container with id ed3abd8b724b0a31f38405d33e1ed69e366ba46825561a30e6b9faac72cfa034
Jul 30 20:22:17.844722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:17.844676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8v5lt"]
Jul 30 20:22:17.848176 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:17.848150    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b7df1b_3a67_452f_b7cf_1b40fae23455.slice/crio-adc115961db5d513575465e54519fac123868ab35ca90853f1256d310f02f051 WatchSource:0}: Error finding container adc115961db5d513575465e54519fac123868ab35ca90853f1256d310f02f051: Status 404 returned error can't find the container with id adc115961db5d513575465e54519fac123868ab35ca90853f1256d310f02f051
Jul 30 20:22:18.037008 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.036968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:18.039659 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.039637    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b0df97c4-d860-44b6-8c57-02bc64a114b1-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-6gdgf\" (UID: \"b0df97c4-d860-44b6-8c57-02bc64a114b1\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:18.139539 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.139502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v5lt" event={"ID":"83b7df1b-3a67-452f-b7cf-1b40fae23455","Type":"ContainerStarted","Data":"adc115961db5d513575465e54519fac123868ab35ca90853f1256d310f02f051"}
Jul 30 20:22:18.140703 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.140671    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wpprs" event={"ID":"ee134adb-7f74-4f68-93da-b104a529afe5","Type":"ContainerStarted","Data":"ed3abd8b724b0a31f38405d33e1ed69e366ba46825561a30e6b9faac72cfa034"}
Jul 30 20:22:18.141762 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.141740    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9vtn" event={"ID":"21c16074-1a8f-4b64-928f-97d5d546fa1f","Type":"ContainerStarted","Data":"3425256a28513e351fc7f1614d46a051fff5396dbf70dc94d77a0bc661dae393"}
Jul 30 20:22:18.267083 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.267043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"
Jul 30 20:22:18.423715 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.423633    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-6gdgf"]
Jul 30 20:22:18.428118 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:18.428077    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0df97c4_d860_44b6_8c57_02bc64a114b1.slice/crio-a74e7fd468b6cd833f8209530d2f80e6950c4e9413838b5f298c8ac5cb89edde WatchSource:0}: Error finding container a74e7fd468b6cd833f8209530d2f80e6950c4e9413838b5f298c8ac5cb89edde: Status 404 returned error can't find the container with id a74e7fd468b6cd833f8209530d2f80e6950c4e9413838b5f298c8ac5cb89edde
Jul 30 20:22:18.944680 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.944633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:22:18.947602 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:18.947577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c7124637-e339-447e-9a13-b5d23232dfb4-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-r58hb\" (UID: \"c7124637-e339-447e-9a13-b5d23232dfb4\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:22:19.147142 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:19.147101    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf" event={"ID":"b0df97c4-d860-44b6-8c57-02bc64a114b1","Type":"ContainerStarted","Data":"a74e7fd468b6cd833f8209530d2f80e6950c4e9413838b5f298c8ac5cb89edde"}
Jul 30 20:22:19.216609 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:19.216542    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8x29d\""
Jul 30 20:22:19.224916 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:19.224887    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"
Jul 30 20:22:19.422257 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:19.422218    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-r58hb"]
Jul 30 20:22:19.430612 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:19.430579    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7124637_e339_447e_9a13_b5d23232dfb4.slice/crio-2bfb3c45346bac3eabb878db23f2aa712e8980c08c9548b8ada11d9cb292b888 WatchSource:0}: Error finding container 2bfb3c45346bac3eabb878db23f2aa712e8980c08c9548b8ada11d9cb292b888: Status 404 returned error can't find the container with id 2bfb3c45346bac3eabb878db23f2aa712e8980c08c9548b8ada11d9cb292b888
Jul 30 20:22:20.155668 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.155627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v5lt" event={"ID":"83b7df1b-3a67-452f-b7cf-1b40fae23455","Type":"ContainerStarted","Data":"b4342350f1e8027ccc841c4a525e5fcfaf0adb4bd64226004fe3e04fab35c0f0"}
Jul 30 20:22:20.156205 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.155723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8v5lt" event={"ID":"83b7df1b-3a67-452f-b7cf-1b40fae23455","Type":"ContainerStarted","Data":"caddd7ed3c3ddead9f42c91e04f8d68bbbb0879d497c4a4f06d7bd3b25e43f39"}
Jul 30 20:22:20.157907 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.157873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb" event={"ID":"c7124637-e339-447e-9a13-b5d23232dfb4","Type":"ContainerStarted","Data":"2bfb3c45346bac3eabb878db23f2aa712e8980c08c9548b8ada11d9cb292b888"}
Jul 30 20:22:20.173713 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.173400    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8v5lt" podStartSLOduration=65.864751594 podStartE2EDuration="1m7.173378417s" totalImagesPullingTime="1.308626823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:20.1719906 +0000 UTC m=+67.934911134" watchObservedRunningTime="2026-07-30 20:22:20.173378417 +0000 UTC m=+67.936298952"
Jul 30 20:22:20.398232 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.398195    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-hx444"]
Jul 30 20:22:20.428513 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.428409    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-hx444"]
Jul 30 20:22:20.428670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.428527    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:20.431384 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.431358    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g798x\""
Jul 30 20:22:20.432107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.431595    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 20:22:20.432107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.431849    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 20:22:20.557065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.557019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4h2\" (UniqueName: \"kubernetes.io/projected/f2a11557-5bc4-4d94-b17d-4c8a9d893281-kube-api-access-jx4h2\") pod \"downloads-77c974ffcf-hx444\" (UID: \"f2a11557-5bc4-4d94-b17d-4c8a9d893281\") " pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:20.657639 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.657606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4h2\" (UniqueName: \"kubernetes.io/projected/f2a11557-5bc4-4d94-b17d-4c8a9d893281-kube-api-access-jx4h2\") pod \"downloads-77c974ffcf-hx444\" (UID: \"f2a11557-5bc4-4d94-b17d-4c8a9d893281\") " pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:20.668521 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.668462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4h2\" (UniqueName: \"kubernetes.io/projected/f2a11557-5bc4-4d94-b17d-4c8a9d893281-kube-api-access-jx4h2\") pod \"downloads-77c974ffcf-hx444\" (UID: \"f2a11557-5bc4-4d94-b17d-4c8a9d893281\") " pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:20.741789 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:20.741757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:22.575460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:22.575416    2583 patch_prober.go:28] interesting pod/image-registry-bb47856c6-58xmp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 30 20:22:22.575918 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:22.575495    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:22:23.437821 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:23.437749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-hx444"]
Jul 30 20:22:23.442513 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:23.442468    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a11557_5bc4_4d94_b17d_4c8a9d893281.slice/crio-84511bd9eeaacbe7c496f9693d29a9f6a8ecce4ea1ce12b38088720d09c2496b WatchSource:0}: Error finding container 84511bd9eeaacbe7c496f9693d29a9f6a8ecce4ea1ce12b38088720d09c2496b: Status 404 returned error can't find the container with id 84511bd9eeaacbe7c496f9693d29a9f6a8ecce4ea1ce12b38088720d09c2496b
Jul 30 20:22:24.085377 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.085343    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:24.176431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.176168    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf" event={"ID":"b0df97c4-d860-44b6-8c57-02bc64a114b1","Type":"ContainerStarted","Data":"c3d8924f0a202e905fb9cd9ae58df3fb8b3b9c76b02a0c35feadb9729ec57c42"}
Jul 30 20:22:24.176431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.176245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf" event={"ID":"b0df97c4-d860-44b6-8c57-02bc64a114b1","Type":"ContainerStarted","Data":"b4e419b77a2f15335e7f935efd453b07da8e16196d6b72033fb3fa4b970385b6"}
Jul 30 20:22:24.178893 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.178845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb" event={"ID":"c7124637-e339-447e-9a13-b5d23232dfb4","Type":"ContainerStarted","Data":"6f116eee4557a89ad6e247bf28003e3596588bc53f6ba371368446015ee3f52d"}
Jul 30 20:22:24.180783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.180437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-hx444" event={"ID":"f2a11557-5bc4-4d94-b17d-4c8a9d893281","Type":"ContainerStarted","Data":"84511bd9eeaacbe7c496f9693d29a9f6a8ecce4ea1ce12b38088720d09c2496b"}
Jul 30 20:22:24.182845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.182814    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wpprs" event={"ID":"ee134adb-7f74-4f68-93da-b104a529afe5","Type":"ContainerStarted","Data":"f0cc93c714ff884384537fef8f45e9b5041612dfc76013f9e35a8bc2b957b7b5"}
Jul 30 20:22:24.182978 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.182890    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:22:24.184396 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.184369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9vtn" event={"ID":"21c16074-1a8f-4b64-928f-97d5d546fa1f","Type":"ContainerStarted","Data":"ee8d19d8d9dd793bf2ba112c1d378549ea176cb448eb358e2d6e1c3fb45dad32"}
Jul 30 20:22:24.197743 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.197680    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-6gdgf" podStartSLOduration=2.345135647 podStartE2EDuration="7.197663773s" totalImagesPullingTime="4.852528126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:24.195631143 +0000 UTC m=+71.958551679" watchObservedRunningTime="2026-07-30 20:22:24.197663773 +0000 UTC m=+71.960584334"
Jul 30 20:22:24.225531 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.225476    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wpprs" podStartSLOduration=66.774707927 podStartE2EDuration="1m12.225459819s" totalImagesPullingTime="5.450751892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:24.224945325 +0000 UTC m=+71.987865871" watchObservedRunningTime="2026-07-30 20:22:24.225459819 +0000 UTC m=+71.988380352"
Jul 30 20:22:24.226351 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.226310    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9vtn" podStartSLOduration=65.754721114 podStartE2EDuration="1m11.226293367s" totalImagesPullingTime="5.471572253s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:24.211403697 +0000 UTC m=+71.974324233" watchObservedRunningTime="2026-07-30 20:22:24.226293367 +0000 UTC m=+71.989213883"
Jul 30 20:22:24.239272 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:24.239210    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-r58hb" podStartSLOduration=33.366845606 podStartE2EDuration="37.239189692s" totalImagesPullingTime="3.872344086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:24.237858436 +0000 UTC m=+72.000778971" watchObservedRunningTime="2026-07-30 20:22:24.239189692 +0000 UTC m=+72.002110228"
Jul 30 20:22:25.749112 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.749076    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"]
Jul 30 20:22:25.752251 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.752234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:25.755055 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.755034    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7zsq2\""
Jul 30 20:22:25.755180 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.755152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 30 20:22:25.755432 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.755398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 30 20:22:25.769208 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.769184    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"]
Jul 30 20:22:25.772484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.772458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.773162 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.773135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"]
Jul 30 20:22:25.774561 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.774537    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kvq9r"]
Jul 30 20:22:25.775952 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.775888    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 30 20:22:25.776171 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.776150    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 30 20:22:25.776319 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.776284    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 30 20:22:25.776425 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.776379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xx6sz\""
Jul 30 20:22:25.778470 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.778448    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.781820 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.781778    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 20:22:25.781970 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.781951    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 20:22:25.782042 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.782031    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6lm9q\""
Jul 30 20:22:25.782421 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.782399    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 20:22:25.791485 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.791463    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"]
Jul 30 20:22:25.899918 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.899881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.899918 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.899917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-sys\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.899939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.899958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pvhp\" (UniqueName: \"kubernetes.io/projected/8ca2de02-3954-4d95-830f-b04db42ad572-kube-api-access-9pvhp\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-metrics-client-ca\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-root\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-wtmp\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp2dq\" (UniqueName: \"kubernetes.io/projected/3aa74161-e0d2-43b8-9879-52cf87d36d09-kube-api-access-mp2dq\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khf2d\" (UniqueName: \"kubernetes.io/projected/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-kube-api-access-khf2d\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ca2de02-3954-4d95-830f-b04db42ad572-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900358    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:25.900784 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-textfile\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:25.900784 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:25.900784 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:25.900579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.001306 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.001306 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-wtmp\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp2dq\" (UniqueName: \"kubernetes.io/projected/3aa74161-e0d2-43b8-9879-52cf87d36d09-kube-api-access-mp2dq\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khf2d\" (UniqueName: \"kubernetes.io/projected/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-kube-api-access-khf2d\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ca2de02-3954-4d95-830f-b04db42ad572-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.001529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-textfile\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001558    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-wtmp\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-sys\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pvhp\" (UniqueName: \"kubernetes.io/projected/8ca2de02-3954-4d95-830f-b04db42ad572-kube-api-access-9pvhp\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-metrics-client-ca\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-root\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-root\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.001948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-accelerators-collector-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002571 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:26.002048    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 30 20:22:26.002571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002052    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8ca2de02-3954-4d95-830f-b04db42ad572-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002571 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:26.002105    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls podName:3aa74161-e0d2-43b8-9879-52cf87d36d09 nodeName:}" failed. No retries permitted until 2026-07-30 20:22:26.502086849 +0000 UTC m=+74.265007364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls") pod "node-exporter-kvq9r" (UID: "3aa74161-e0d2-43b8-9879-52cf87d36d09") : secret "node-exporter-tls" not found
Jul 30 20:22:26.002571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002808 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002652    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.002808 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3aa74161-e0d2-43b8-9879-52cf87d36d09-sys\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002808 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-textfile\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.002964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.002884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3aa74161-e0d2-43b8-9879-52cf87d36d09-metrics-client-ca\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.003477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.003450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.004901 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.004842    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.004901 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.004841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.005072 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.004962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.005072 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.004989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.005289 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.005271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ca2de02-3954-4d95-830f-b04db42ad572-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.010370 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.010347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp2dq\" (UniqueName: \"kubernetes.io/projected/3aa74161-e0d2-43b8-9879-52cf87d36d09-kube-api-access-mp2dq\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.010847 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.010831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pvhp\" (UniqueName: \"kubernetes.io/projected/8ca2de02-3954-4d95-830f-b04db42ad572-kube-api-access-9pvhp\") pod \"kube-state-metrics-6bd9664c4-p85pb\" (UID: \"8ca2de02-3954-4d95-830f-b04db42ad572\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.011050 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.011030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khf2d\" (UniqueName: \"kubernetes.io/projected/9fc2bd71-7c47-4878-bbab-089e31ffdd4a-kube-api-access-khf2d\") pod \"openshift-state-metrics-6bb4d7b4dd-m28db\" (UID: \"9fc2bd71-7c47-4878-bbab-089e31ffdd4a\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.061465 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.061432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"
Jul 30 20:22:26.085153 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.085122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"
Jul 30 20:22:26.236132 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.222114    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db"]
Jul 30 20:22:26.259575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.259537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb"]
Jul 30 20:22:26.267870 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:26.267832    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca2de02_3954_4d95_830f_b04db42ad572.slice/crio-97dfd1904bb6a6975858fe8ab17976be3f15d03859cd383533b292e02d487e16 WatchSource:0}: Error finding container 97dfd1904bb6a6975858fe8ab17976be3f15d03859cd383533b292e02d487e16: Status 404 returned error can't find the container with id 97dfd1904bb6a6975858fe8ab17976be3f15d03859cd383533b292e02d487e16
Jul 30 20:22:26.506649 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.506559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.509394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.509369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3aa74161-e0d2-43b8-9879-52cf87d36d09-node-exporter-tls\") pod \"node-exporter-kvq9r\" (UID: \"3aa74161-e0d2-43b8-9879-52cf87d36d09\") " pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.692322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.692278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kvq9r"
Jul 30 20:22:26.704470 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:26.704431    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa74161_e0d2_43b8_9879_52cf87d36d09.slice/crio-d3666c6bd9dc4d81318e14b70cc67cc0103a14cd743c533e5ec47d7d1c8a69ae WatchSource:0}: Error finding container d3666c6bd9dc4d81318e14b70cc67cc0103a14cd743c533e5ec47d7d1c8a69ae: Status 404 returned error can't find the container with id d3666c6bd9dc4d81318e14b70cc67cc0103a14cd743c533e5ec47d7d1c8a69ae
Jul 30 20:22:26.798709 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.797991    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:22:26.802237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.802210    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.804907 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.804878    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 20:22:26.805278 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.805140    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 20:22:26.805915 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.805897    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 20:22:26.806058 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.805978    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 20:22:26.806218 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.806199    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 20:22:26.806482 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.806426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 20:22:26.806831 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.806652    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 20:22:26.806831 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.806739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 20:22:26.807227 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.806861    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 20:22:26.807227 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.807102    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pxtpr\""
Jul 30 20:22:26.820479 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.820453    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:22:26.910589 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910804 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910804 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910804 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910765    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910908    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.910981 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmm7\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.911210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.910983    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.911210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.911009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.911210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.911033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:26.911210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:26.911058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012074 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmm7\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012230 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012275    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012372    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.012643 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.012439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.014099 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:27.013204    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle podName:cc651826-54c4-447f-9204-b2dacbdf8cce nodeName:}" failed. No retries permitted until 2026-07-30 20:22:27.513179743 +0000 UTC m=+75.276100258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce") : configmap references non-existent config key: ca-bundle.crt
Jul 30 20:22:27.014099 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.013831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.014099 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.013876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.017802 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.017769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.020663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.021072 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.020923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.021383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.021357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.026262 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.026238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmm7\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.202957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.202861    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb" event={"ID":"8ca2de02-3954-4d95-830f-b04db42ad572","Type":"ContainerStarted","Data":"97dfd1904bb6a6975858fe8ab17976be3f15d03859cd383533b292e02d487e16"}
Jul 30 20:22:27.204533 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.204496    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kvq9r" event={"ID":"3aa74161-e0d2-43b8-9879-52cf87d36d09","Type":"ContainerStarted","Data":"d3666c6bd9dc4d81318e14b70cc67cc0103a14cd743c533e5ec47d7d1c8a69ae"}
Jul 30 20:22:27.206628 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.206589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db" event={"ID":"9fc2bd71-7c47-4878-bbab-089e31ffdd4a","Type":"ContainerStarted","Data":"c6ef1475b64e8100a0c45ab602ba70039c26072495080ce5f0e3acf5fffb106f"}
Jul 30 20:22:27.206787 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.206663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db" event={"ID":"9fc2bd71-7c47-4878-bbab-089e31ffdd4a","Type":"ContainerStarted","Data":"6a072ffccfc3386ef05423e2ef91a5159b6e24441f668aeca477f7969e18143b"}
Jul 30 20:22:27.206787 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.206717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db" event={"ID":"9fc2bd71-7c47-4878-bbab-089e31ffdd4a","Type":"ContainerStarted","Data":"1f4b81f329921b5c25361d2242c5f12ff5d21544e263f3aca1b998e9f3a2a3ab"}
Jul 30 20:22:27.518121 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.518031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.519109 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.519051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:27.716166 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:27.716119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:22:28.214523 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.214475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db" event={"ID":"9fc2bd71-7c47-4878-bbab-089e31ffdd4a","Type":"ContainerStarted","Data":"fc51cff3a409ea4c1e37b3bea2d80905a8056f4bf1cfcdda1ec8cd270cc65b80"}
Jul 30 20:22:28.236589 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.236520    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-m28db" podStartSLOduration=2.282533657 podStartE2EDuration="3.236503497s" totalImagesPullingTime="953.96984ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:28.234833215 +0000 UTC m=+75.997753749" watchObservedRunningTime="2026-07-30 20:22:28.236503497 +0000 UTC m=+75.999424030"
Jul 30 20:22:28.531016 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.530638    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:22:28.727902 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.725908    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-868979c4cc-w7dfp"]
Jul 30 20:22:28.731562 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.730293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.733712 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.733662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d5hbr\""
Jul 30 20:22:28.734383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.733843    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 20:22:28.734383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.734050    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 20:22:28.734383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.734096    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ehn9oum9ipg6e\""
Jul 30 20:22:28.734383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.734053    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 20:22:28.734383 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.734264    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 20:22:28.734756 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.734548    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 20:22:28.743156 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.743049    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-868979c4cc-w7dfp"]
Jul 30 20:22:28.832060 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832022    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb661b-f022-4ce9-bfc9-5019ca3141c8-metrics-client-ca\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbk5j\" (UniqueName: \"kubernetes.io/projected/09fb661b-f022-4ce9-bfc9-5019ca3141c8-kube-api-access-cbk5j\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832168    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-grpc-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832242 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.832489 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.832324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-grpc-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933544 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933377    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933637 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933713 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933757 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933812 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933775    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb661b-f022-4ce9-bfc9-5019ca3141c8-metrics-client-ca\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.933865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.933811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbk5j\" (UniqueName: \"kubernetes.io/projected/09fb661b-f022-4ce9-bfc9-5019ca3141c8-kube-api-access-cbk5j\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.935508 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.935472    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09fb661b-f022-4ce9-bfc9-5019ca3141c8-metrics-client-ca\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.936582 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.936514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.936745 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.936591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.936895 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.936866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.937014 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.936992    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.937077 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.937039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-thanos-querier-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.937595 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.937577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/09fb661b-f022-4ce9-bfc9-5019ca3141c8-secret-grpc-tls\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:28.946140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:28.946080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbk5j\" (UniqueName: \"kubernetes.io/projected/09fb661b-f022-4ce9-bfc9-5019ca3141c8-kube-api-access-cbk5j\") pod \"thanos-querier-868979c4cc-w7dfp\" (UID: \"09fb661b-f022-4ce9-bfc9-5019ca3141c8\") " pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:29.043096 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.042995    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:29.207374 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.207269    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-868979c4cc-w7dfp"]
Jul 30 20:22:29.211287 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:29.211254    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09fb661b_f022_4ce9_bfc9_5019ca3141c8.slice/crio-7996878b476e3c750ce53427dae05c740702a3a4568281ea40846a92a2a8a944 WatchSource:0}: Error finding container 7996878b476e3c750ce53427dae05c740702a3a4568281ea40846a92a2a8a944: Status 404 returned error can't find the container with id 7996878b476e3c750ce53427dae05c740702a3a4568281ea40846a92a2a8a944
Jul 30 20:22:29.222709 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.222643    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb" event={"ID":"8ca2de02-3954-4d95-830f-b04db42ad572","Type":"ContainerStarted","Data":"5a606ff02cc1d76e94e53c4d6d9c5cbae370b7b1b1f7c44e708ad592597b4f6a"}
Jul 30 20:22:29.223260 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.223229    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb" event={"ID":"8ca2de02-3954-4d95-830f-b04db42ad572","Type":"ContainerStarted","Data":"5a701582c1cab9b99187577ba6202af1923e345cf99337d10ce3aba43dea2065"}
Jul 30 20:22:29.223370 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.223282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb" event={"ID":"8ca2de02-3954-4d95-830f-b04db42ad572","Type":"ContainerStarted","Data":"4197b47c97595df7fa03d2b3c0e481dd6280d28834059b904f35bb0fa05e824f"}
Jul 30 20:22:29.224267 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.224191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"7996878b476e3c750ce53427dae05c740702a3a4568281ea40846a92a2a8a944"}
Jul 30 20:22:29.227079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.226419    2583 generic.go:356] "Generic (PLEG): container finished" podID="3aa74161-e0d2-43b8-9879-52cf87d36d09" containerID="1b52fa1d70e51954f183f4ffc1aaa043bd7f332d6251c97d26a77393c0e4b014" exitCode=0
Jul 30 20:22:29.227079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.226509    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kvq9r" event={"ID":"3aa74161-e0d2-43b8-9879-52cf87d36d09","Type":"ContainerDied","Data":"1b52fa1d70e51954f183f4ffc1aaa043bd7f332d6251c97d26a77393c0e4b014"}
Jul 30 20:22:29.228329 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.228300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"966b4c5f9cfce6484b03fcb9cc34ab382ab79501fb30d298271c1a2c6d7ee072"}
Jul 30 20:22:29.242506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:29.242463    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-p85pb" podStartSLOduration=2.149735789 podStartE2EDuration="4.242447209s" totalImagesPullingTime="2.09271142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:29.240488453 +0000 UTC m=+77.003409002" watchObservedRunningTime="2026-07-30 20:22:29.242447209 +0000 UTC m=+77.005367742"
Jul 30 20:22:30.027923 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.027786    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f97fc9b75-rfxg7"]
Jul 30 20:22:30.032985 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.032956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.037500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.036796    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 20:22:30.037500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.037096    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 20:22:30.037500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.037111    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dsafqkvb9dvtg\""
Jul 30 20:22:30.037767 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.037526    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 20:22:30.038124 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.037875    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 20:22:30.038124 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.037960    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-n5nf4\""
Jul 30 20:22:30.045744 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.045006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f97fc9b75-rfxg7"]
Jul 30 20:22:30.147555 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147507    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-client-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.147750 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-client-certs\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.147750 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147616    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.147750 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26fba55c-a706-4d1a-8eab-19834a7141b7-audit-log\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.147750 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptsfr\" (UniqueName: \"kubernetes.io/projected/26fba55c-a706-4d1a-8eab-19834a7141b7-kube-api-access-ptsfr\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.147750 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147719    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-metrics-server-audit-profiles\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.148015 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.147751    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-tls\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.235814 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.235772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kvq9r" event={"ID":"3aa74161-e0d2-43b8-9879-52cf87d36d09","Type":"ContainerStarted","Data":"24ba459c820552a75be372ec8264b5bc1e8037a4a8b89cb1e7b6b1684bbf5e60"}
Jul 30 20:22:30.236241 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.235843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kvq9r" event={"ID":"3aa74161-e0d2-43b8-9879-52cf87d36d09","Type":"ContainerStarted","Data":"b2c6d50aa7aaf5ab7532ae35e488faa9d8c65f36ba04ba0b4ba3b538d22e063a"}
Jul 30 20:22:30.238258 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.238224    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533" exitCode=0
Jul 30 20:22:30.238410 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.238382    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"}
Jul 30 20:22:30.249209 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-client-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-client-certs\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26fba55c-a706-4d1a-8eab-19834a7141b7-audit-log\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249449 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249336    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptsfr\" (UniqueName: \"kubernetes.io/projected/26fba55c-a706-4d1a-8eab-19834a7141b7-kube-api-access-ptsfr\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249449 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-metrics-server-audit-profiles\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.249449 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.249394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-tls\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.250292 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.250242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.250717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.250504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/26fba55c-a706-4d1a-8eab-19834a7141b7-metrics-server-audit-profiles\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.250717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.250659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/26fba55c-a706-4d1a-8eab-19834a7141b7-audit-log\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.252322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.252298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-client-ca-bundle\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.252822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.252780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-client-certs\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.253943    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/26fba55c-a706-4d1a-8eab-19834a7141b7-secret-metrics-server-tls\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.258377 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.258329    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kvq9r" podStartSLOduration=3.5161359599999997 podStartE2EDuration="5.25831146s" totalImagesPullingTime="1.654440139s" totalInitContainerRuntime="87.735361ms" isStatefulPod=true podCreationTimestamp="2026-07-30 20:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:30.257827863 +0000 UTC m=+78.020748400" watchObservedRunningTime="2026-07-30 20:22:30.25831146 +0000 UTC m=+78.021231996"
Jul 30 20:22:30.261762 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.261717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptsfr\" (UniqueName: \"kubernetes.io/projected/26fba55c-a706-4d1a-8eab-19834a7141b7-kube-api-access-ptsfr\") pod \"metrics-server-f97fc9b75-rfxg7\" (UID: \"26fba55c-a706-4d1a-8eab-19834a7141b7\") " pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.348818 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.348732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:30.518830 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.518794    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f97fc9b75-rfxg7"]
Jul 30 20:22:30.522652 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:30.522609    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fba55c_a706_4d1a_8eab_19834a7141b7.slice/crio-f82a46f8c6ce47c431072db2051247d34abd048dfe70ec15321e2f1546c22fe6 WatchSource:0}: Error finding container f82a46f8c6ce47c431072db2051247d34abd048dfe70ec15321e2f1546c22fe6: Status 404 returned error can't find the container with id f82a46f8c6ce47c431072db2051247d34abd048dfe70ec15321e2f1546c22fe6
Jul 30 20:22:30.967562 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.966986    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-66f9ff958-2w8gq"]
Jul 30 20:22:30.972568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.972536    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:30.975845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975589    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 30 20:22:30.975845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975650    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 30 20:22:30.975845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 30 20:22:30.975845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975738    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 30 20:22:30.975845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975762    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ld5c8\""
Jul 30 20:22:30.976191 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.975875    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 30 20:22:30.981613 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.981586    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 30 20:22:30.983305 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:30.983228    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f9ff958-2w8gq"]
Jul 30 20:22:31.057134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkr6p\" (UniqueName: \"kubernetes.io/projected/348a5d48-8e01-49b1-982f-080afacd5178-kube-api-access-gkr6p\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057223    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057486 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-serving-certs-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057486 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-metrics-client-ca\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057590 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.057590 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.057524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-federate-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkr6p\" (UniqueName: \"kubernetes.io/projected/348a5d48-8e01-49b1-982f-080afacd5178-kube-api-access-gkr6p\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158455    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158537    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-serving-certs-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-metrics-client-ca\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.158793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.158735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-federate-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.159855 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.159827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-serving-certs-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.159970 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.159928    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-metrics-client-ca\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.160296 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.160246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-trusted-ca-bundle\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.162255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.162226    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.162572 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.162548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-telemeter-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.162680 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.162606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-federate-client-tls\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.163189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.163160    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/348a5d48-8e01-49b1-982f-080afacd5178-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.167296 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.167263    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkr6p\" (UniqueName: \"kubernetes.io/projected/348a5d48-8e01-49b1-982f-080afacd5178-kube-api-access-gkr6p\") pod \"telemeter-client-66f9ff958-2w8gq\" (UID: \"348a5d48-8e01-49b1-982f-080afacd5178\") " pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.246318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.246270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7" event={"ID":"26fba55c-a706-4d1a-8eab-19834a7141b7","Type":"ContainerStarted","Data":"f82a46f8c6ce47c431072db2051247d34abd048dfe70ec15321e2f1546c22fe6"}
Jul 30 20:22:31.287669 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.287638    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq"
Jul 30 20:22:31.480233 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:31.480193    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-66f9ff958-2w8gq"]
Jul 30 20:22:32.027735 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.027696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:22:32.033101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.033074    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.036703 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.036457    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.037425    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.037648    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m8gtp\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.037936    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.038139    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.038389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.038624    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.038889    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.039105    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.039377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95nabee0dr1qv\""
Jul 30 20:22:32.040493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.040349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 20:22:32.044257 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.041278    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 20:22:32.044257 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.042533    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 20:22:32.044257 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.042884    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 20:22:32.045340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.045163    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 20:22:32.051758 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.049585    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 20:22:32.052201 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.051892    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:22:32.170275 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170402    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.170752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.171158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.171158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.171158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.171158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.170876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7dt\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.254967 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.254852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq" event={"ID":"348a5d48-8e01-49b1-982f-080afacd5178","Type":"ContainerStarted","Data":"d27f914ee31204d7a9cd00e5bf60a0388d6ae638715ae7b8fef3608c7ac5bab5"}
Jul 30 20:22:32.259524 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.259309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"3d25a7e31868e81320fb7a760fd61ee7b9487c97d444c80410147f5a5fd3c430"}
Jul 30 20:22:32.259524 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.259397    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"e805009211f7a96b53f3cdd7274c014ef35a895f4b07e410a83686b861b35107"}
Jul 30 20:22:32.259524 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.259444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"e80209d15bd9b5b73696cb30e0c3cb2dd2de5939573ac8da0a8eae9136bfd92c"}
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271760    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7dt\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.272210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.274067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.274067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.271988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.274067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.272020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.274067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.272508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.277805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.275082    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.277805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.275436    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.277805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.275901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.277805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.276059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.277805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.277452    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.280717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.280553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.281763 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.281192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.281763 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.281631    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.284929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.284878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.286039 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.285960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7dt\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.289137 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.289051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.289802 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.289762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.289884 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.289854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.290910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.290353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.291528 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.291051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.291528 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.291410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.292541 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.292492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.292841 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.292818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.294203 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.294183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.356423 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.356083    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:32.482438 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:32.482399    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:22:34.200678 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.199545    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:22:34.210221 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:22:34.210091    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1ce85b_0346_4641_a65a_3634f0d99741.slice/crio-b85169187043e889eafe17e937d39084c486cc86a61366a3dc82e690c9cca56b WatchSource:0}: Error finding container b85169187043e889eafe17e937d39084c486cc86a61366a3dc82e690c9cca56b: Status 404 returned error can't find the container with id b85169187043e889eafe17e937d39084c486cc86a61366a3dc82e690c9cca56b
Jul 30 20:22:34.276625 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.276527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7" event={"ID":"26fba55c-a706-4d1a-8eab-19834a7141b7","Type":"ContainerStarted","Data":"11662c1dc5a9d6ef519af84077a99d09eded7075868da56164481c9f5094c39b"}
Jul 30 20:22:34.285324 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.285238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq" event={"ID":"348a5d48-8e01-49b1-982f-080afacd5178","Type":"ContainerStarted","Data":"5e76b072d8366a33ed5121d0157da6aa817d32ebc5f247b41317d9b007a075ec"}
Jul 30 20:22:34.291204 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.291150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"3b4f02b9ec9545a2df68fc67cbb6444b38bf968877a493bb4329d8449305e7cc"}
Jul 30 20:22:34.291366 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.291236    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"e93c10a47fd6b10385176d1048ded0b2965984547d2a40e8ec21bae17dad6cac"}
Jul 30 20:22:34.309289 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.309226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"}
Jul 30 20:22:34.316980 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:34.316570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"b85169187043e889eafe17e937d39084c486cc86a61366a3dc82e690c9cca56b"}
Jul 30 20:22:35.325584 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.325506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" event={"ID":"09fb661b-f022-4ce9-bfc9-5019ca3141c8","Type":"ContainerStarted","Data":"ebfa43ec6d086d20dae69db8d2ed14e89eb4a9a5940cf1ad6704cb90f933efcf"}
Jul 30 20:22:35.326047 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.325624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:35.328525 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.328497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"}
Jul 30 20:22:35.328662 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.328569    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"}
Jul 30 20:22:35.330152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.330119    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31" exitCode=0
Jul 30 20:22:35.330249 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.330158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31"}
Jul 30 20:22:35.332890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.332864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq" event={"ID":"348a5d48-8e01-49b1-982f-080afacd5178","Type":"ContainerStarted","Data":"c6a68f7f2bc7e3531fe50b47375704ba4abdd0a6db411f1ca1732b387460c247"}
Jul 30 20:22:35.332996 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.332915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq" event={"ID":"348a5d48-8e01-49b1-982f-080afacd5178","Type":"ContainerStarted","Data":"150e5eeeef2e163f2808254a3b0ebd776be1cb5a50db765ff3d8e553ebc28efc"}
Jul 30 20:22:35.349715 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.349437    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7" podStartSLOduration=1.856010795 podStartE2EDuration="5.349414915s" totalImagesPullingTime="3.49340412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:34.299788487 +0000 UTC m=+82.062709021" watchObservedRunningTime="2026-07-30 20:22:35.349414915 +0000 UTC m=+83.112335449"
Jul 30 20:22:35.350372 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.350336    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp" podStartSLOduration=2.849270153 podStartE2EDuration="7.350324502s" totalImagesPullingTime="4.501054349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:35.347374678 +0000 UTC m=+83.110295213" watchObservedRunningTime="2026-07-30 20:22:35.350324502 +0000 UTC m=+83.113245037"
Jul 30 20:22:35.368154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:35.368107    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-66f9ff958-2w8gq" podStartSLOduration=2.778134284 podStartE2EDuration="5.368092094s" totalImagesPullingTime="2.58995781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:35.366144078 +0000 UTC m=+83.129064614" watchObservedRunningTime="2026-07-30 20:22:35.368092094 +0000 UTC m=+83.131012628"
Jul 30 20:22:36.346166 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:36.346135    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-868979c4cc-w7dfp"
Jul 30 20:22:42.373726 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.373617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"}
Jul 30 20:22:42.374213 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.373750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"}
Jul 30 20:22:42.374213 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.373799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerStarted","Data":"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"}
Jul 30 20:22:42.375415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.375379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-hx444" event={"ID":"f2a11557-5bc4-4d94-b17d-4c8a9d893281","Type":"ContainerStarted","Data":"a19a88479e824075c833aa141f94dbe662069942fb620bfe4705168cb938a79f"}
Jul 30 20:22:42.375588 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.375569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:42.377182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.377152    2583 patch_prober.go:28] interesting pod/downloads-77c974ffcf-hx444 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body=
Jul 30 20:22:42.377303 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.377215    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-77c974ffcf-hx444" podUID="f2a11557-5bc4-4d94-b17d-4c8a9d893281" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused"
Jul 30 20:22:42.410400 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.410350    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=11.492826863 podStartE2EDuration="16.410328846s" totalImagesPullingTime="4.898170639s" totalInitContainerRuntime="19.331344ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:42.407936634 +0000 UTC m=+90.170857196" watchObservedRunningTime="2026-07-30 20:22:42.410328846 +0000 UTC m=+90.173249381"
Jul 30 20:22:42.430407 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:42.430353    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-hx444" podStartSLOduration=3.7789501530000003 podStartE2EDuration="22.430330967s" totalImagesPullingTime="18.651380814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:42.428155406 +0000 UTC m=+90.191075943" watchObservedRunningTime="2026-07-30 20:22:42.430330967 +0000 UTC m=+90.193251501"
Jul 30 20:22:43.397468 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:43.397231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-hx444"
Jul 30 20:22:46.401551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"}
Jul 30 20:22:46.401551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"}
Jul 30 20:22:46.402149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"}
Jul 30 20:22:46.402149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"}
Jul 30 20:22:46.402149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401625    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"}
Jul 30 20:22:46.402149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.401653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerStarted","Data":"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"}
Jul 30 20:22:46.433168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:46.433110    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.116636294 podStartE2EDuration="14.433088431s" totalImagesPullingTime="10.294153886s" totalInitContainerRuntime="22.298251ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:22:46.431388082 +0000 UTC m=+94.194308650" watchObservedRunningTime="2026-07-30 20:22:46.433088431 +0000 UTC m=+94.196008969"
Jul 30 20:22:47.357474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:47.357424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:22:50.349966 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:50.349924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:50.350425 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:50.350004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:22:55.191841 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:55.191810    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wpprs"
Jul 30 20:22:57.509556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.509490    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerName="registry" containerID="cri-o://edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64" gracePeriod=30
Jul 30 20:22:57.807712 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.807649    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:57.930809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930772    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.930809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930814    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930840    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930855    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt6pv\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930923    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.930968    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.931015    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration\") pod \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\" (UID: \"b398ddb8-8651-44f9-913d-0219f1bd6bd4\") "
Jul 30 20:22:57.931511 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.931477    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:22:57.931816 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.931739    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:22:57.933510 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.933475    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:22:57.933622 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.933538    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:57.933737 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.933639    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv" (OuterVolumeSpecName: "kube-api-access-nt6pv") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "kube-api-access-nt6pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:57.933737 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.933678    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:22:57.933814 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.933734    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:22:57.939810 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:57.939786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b398ddb8-8651-44f9-913d-0219f1bd6bd4" (UID: "b398ddb8-8651-44f9-913d-0219f1bd6bd4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032039    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-image-registry-private-configuration\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032075    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032086    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b398ddb8-8651-44f9-913d-0219f1bd6bd4-ca-trust-extracted\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032096    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-trusted-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032104    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-bound-sa-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032113    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt6pv\" (UniqueName: \"kubernetes.io/projected/b398ddb8-8651-44f9-913d-0219f1bd6bd4-kube-api-access-nt6pv\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032121    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b398ddb8-8651-44f9-913d-0219f1bd6bd4-installation-pull-secrets\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.032134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.032130    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b398ddb8-8651-44f9-913d-0219f1bd6bd4-registry-certificates\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:22:58.461526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.461438    2583 generic.go:356] "Generic (PLEG): container finished" podID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerID="edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64" exitCode=0
Jul 30 20:22:58.461526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.461482    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bb47856c6-58xmp"
Jul 30 20:22:58.461725 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.461483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" event={"ID":"b398ddb8-8651-44f9-913d-0219f1bd6bd4","Type":"ContainerDied","Data":"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"}
Jul 30 20:22:58.461725 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.461610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bb47856c6-58xmp" event={"ID":"b398ddb8-8651-44f9-913d-0219f1bd6bd4","Type":"ContainerDied","Data":"bdbd13aac65a1089a08198d952408a0a4a4f1bd3acf513603f3b56d0fa8188be"}
Jul 30 20:22:58.474732 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.474667    2583 scope.go:117] "RemoveContainer" containerID="edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"
Jul 30 20:22:58.482187 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.482160    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:22:58.483780 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.483766    2583 scope.go:117] "RemoveContainer" containerID="edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"
Jul 30 20:22:58.484099 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:22:58.484077    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64\": container with ID starting with edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64 not found: ID does not exist" containerID="edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"
Jul 30 20:22:58.484193 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.484107    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64"} err="failed to get container status \"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64\": rpc error: code = NotFound desc = could not find container \"edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64\": container with ID starting with edc65456eb634acdbe70fc31e69a239f5bad687c85b6491e3c70f810deb6dd64 not found: ID does not exist"
Jul 30 20:22:58.487540 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.487517    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-bb47856c6-58xmp"]
Jul 30 20:22:58.753478 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:22:58.753435    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" path="/var/lib/kubelet/pods/b398ddb8-8651-44f9-913d-0219f1bd6bd4/volumes"
Jul 30 20:23:10.354793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:10.354758    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:23:10.358905 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:10.358880    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f97fc9b75-rfxg7"
Jul 30 20:23:32.357261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:32.357216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:32.432614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:32.432587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:32.629279 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:32.629211    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:46.095861 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.095826    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096124    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="alertmanager" containerID="cri-o://af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55" gracePeriod=120
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096190    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-metric" containerID="cri-o://926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5" gracePeriod=120
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096217    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-web" containerID="cri-o://66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86" gracePeriod=120
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096239    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="prom-label-proxy" containerID="cri-o://3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d" gracePeriod=120
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096229    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="config-reloader" containerID="cri-o://37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec" gracePeriod=120
Jul 30 20:23:46.096395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.096354    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy" containerID="cri-o://36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393" gracePeriod=120
Jul 30 20:23:46.676575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676541    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d" exitCode=0
Jul 30 20:23:46.676575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676570    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393" exitCode=0
Jul 30 20:23:46.676575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676577    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec" exitCode=0
Jul 30 20:23:46.676575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676583    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55" exitCode=0
Jul 30 20:23:46.676859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"}
Jul 30 20:23:46.676859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"}
Jul 30 20:23:46.676859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"}
Jul 30 20:23:46.676859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:46.676756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"}
Jul 30 20:23:47.348632 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.348606    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.472909 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472818    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.472909 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472869    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.472909 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472905    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472970    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrmm7\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.472994    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473038    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473080    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473194 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473176    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473218    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473273    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out\") pod \"cc651826-54c4-447f-9204-b2dacbdf8cce\" (UID: \"cc651826-54c4-447f-9204-b2dacbdf8cce\") "
Jul 30 20:23:47.473551 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:47.473879 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473599    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.473879 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473621    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-alertmanager-main-db\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.473879 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.473635    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc651826-54c4-447f-9204-b2dacbdf8cce-metrics-client-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.475933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.475888    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.476344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.476221    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7" (OuterVolumeSpecName: "kube-api-access-rrmm7") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "kube-api-access-rrmm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:47.476344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.476236    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:47.476344 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.476263    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out" (OuterVolumeSpecName: "config-out") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:47.476718 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.476655    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.476822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.476791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.477336 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.477311    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume" (OuterVolumeSpecName: "config-volume") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.477942 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.477916    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.481461 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.481436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.488231 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.488209    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config" (OuterVolumeSpecName: "web-config") pod "cc651826-54c4-447f-9204-b2dacbdf8cce" (UID: "cc651826-54c4-447f-9204-b2dacbdf8cce"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:47.574849 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574803    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrmm7\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-kube-api-access-rrmm7\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.574849 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574844    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-main-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.574849 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574855    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.574849 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574865    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-web-config\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574874    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-config-volume\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574882    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc651826-54c4-447f-9204-b2dacbdf8cce-tls-assets\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574890    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574898    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc651826-54c4-447f-9204-b2dacbdf8cce-config-out\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574905    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-cluster-tls-config\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.575103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.574914    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc651826-54c4-447f-9204-b2dacbdf8cce-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:47.689032 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.688996    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5" exitCode=0
Jul 30 20:23:47.689032 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689023    2583 generic.go:356] "Generic (PLEG): container finished" podID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerID="66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86" exitCode=0
Jul 30 20:23:47.689228 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689081    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.689228 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"}
Jul 30 20:23:47.689295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"}
Jul 30 20:23:47.689295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689276    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc651826-54c4-447f-9204-b2dacbdf8cce","Type":"ContainerDied","Data":"966b4c5f9cfce6484b03fcb9cc34ab382ab79501fb30d298271c1a2c6d7ee072"}
Jul 30 20:23:47.689352 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.689310    2583 scope.go:117] "RemoveContainer" containerID="3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"
Jul 30 20:23:47.697360 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.697325    2583 scope.go:117] "RemoveContainer" containerID="926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"
Jul 30 20:23:47.704821 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.704805    2583 scope.go:117] "RemoveContainer" containerID="36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"
Jul 30 20:23:47.713994 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.713971    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:47.715065 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.715050    2583 scope.go:117] "RemoveContainer" containerID="66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"
Jul 30 20:23:47.717784 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.717758    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:47.722665 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.722643    2583 scope.go:117] "RemoveContainer" containerID="37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"
Jul 30 20:23:47.729674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.729655    2583 scope.go:117] "RemoveContainer" containerID="af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"
Jul 30 20:23:47.737089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.737070    2583 scope.go:117] "RemoveContainer" containerID="75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"
Jul 30 20:23:47.741962 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.741942    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:47.742261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742245    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerName="registry"
Jul 30 20:23:47.742261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742258    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerName="registry"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742271    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-metric"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742277    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-metric"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742286    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742291    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742300    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="config-reloader"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742305    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="config-reloader"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742315    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="init-config-reloader"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742321    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="init-config-reloader"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742329    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="alertmanager"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742334    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="alertmanager"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742343    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-web"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742347    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-web"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742358    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="prom-label-proxy"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742364    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="prom-label-proxy"
Jul 30 20:23:47.742405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742407    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-metric"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742417    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b398ddb8-8651-44f9-913d-0219f1bd6bd4" containerName="registry"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742423    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="config-reloader"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742430    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="alertmanager"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742436    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="prom-label-proxy"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742442    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy"
Jul 30 20:23:47.743116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.742448    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" containerName="kube-rbac-proxy-web"
Jul 30 20:23:47.745791 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.745772    2583 scope.go:117] "RemoveContainer" containerID="3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"
Jul 30 20:23:47.746253 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.746120    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d\": container with ID starting with 3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d not found: ID does not exist" containerID="3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"
Jul 30 20:23:47.746253 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.746157    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"} err="failed to get container status \"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d\": rpc error: code = NotFound desc = could not find container \"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d\": container with ID starting with 3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d not found: ID does not exist"
Jul 30 20:23:47.746253 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.746181    2583 scope.go:117] "RemoveContainer" containerID="926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"
Jul 30 20:23:47.746644 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.746624    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5\": container with ID starting with 926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5 not found: ID does not exist" containerID="926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"
Jul 30 20:23:47.746760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.746652    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"} err="failed to get container status \"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5\": rpc error: code = NotFound desc = could not find container \"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5\": container with ID starting with 926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5 not found: ID does not exist"
Jul 30 20:23:47.746760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.746670    2583 scope.go:117] "RemoveContainer" containerID="36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"
Jul 30 20:23:47.747005 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.746984    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393\": container with ID starting with 36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393 not found: ID does not exist" containerID="36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"
Jul 30 20:23:47.747077 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747013    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"} err="failed to get container status \"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393\": rpc error: code = NotFound desc = could not find container \"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393\": container with ID starting with 36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393 not found: ID does not exist"
Jul 30 20:23:47.747077 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747034    2583 scope.go:117] "RemoveContainer" containerID="66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"
Jul 30 20:23:47.747315 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.747296    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86\": container with ID starting with 66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86 not found: ID does not exist" containerID="66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"
Jul 30 20:23:47.747357 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747321    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"} err="failed to get container status \"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86\": rpc error: code = NotFound desc = could not find container \"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86\": container with ID starting with 66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86 not found: ID does not exist"
Jul 30 20:23:47.747357 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747337    2583 scope.go:117] "RemoveContainer" containerID="37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"
Jul 30 20:23:47.747605 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.747584    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec\": container with ID starting with 37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec not found: ID does not exist" containerID="37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"
Jul 30 20:23:47.747660 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747610    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"} err="failed to get container status \"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec\": rpc error: code = NotFound desc = could not find container \"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec\": container with ID starting with 37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec not found: ID does not exist"
Jul 30 20:23:47.747660 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747625    2583 scope.go:117] "RemoveContainer" containerID="af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"
Jul 30 20:23:47.747916 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.747894    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55\": container with ID starting with af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55 not found: ID does not exist" containerID="af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"
Jul 30 20:23:47.747961 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747916    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"} err="failed to get container status \"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55\": rpc error: code = NotFound desc = could not find container \"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55\": container with ID starting with af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55 not found: ID does not exist"
Jul 30 20:23:47.747961 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.747933    2583 scope.go:117] "RemoveContainer" containerID="75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"
Jul 30 20:23:47.748160 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748148    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.748267 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:47.748247    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533\": container with ID starting with 75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533 not found: ID does not exist" containerID="75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"
Jul 30 20:23:47.748327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748273    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"} err="failed to get container status \"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533\": rpc error: code = NotFound desc = could not find container \"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533\": container with ID starting with 75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533 not found: ID does not exist"
Jul 30 20:23:47.748327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748291    2583 scope.go:117] "RemoveContainer" containerID="3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"
Jul 30 20:23:47.748649 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748629    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d"} err="failed to get container status \"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d\": rpc error: code = NotFound desc = could not find container \"3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d\": container with ID starting with 3d8ad7f9eea42889a0dd4d11190d462f3ec996d807553e54ee2646d078c5264d not found: ID does not exist"
Jul 30 20:23:47.748649 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748649    2583 scope.go:117] "RemoveContainer" containerID="926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"
Jul 30 20:23:47.748944 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748902    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5"} err="failed to get container status \"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5\": rpc error: code = NotFound desc = could not find container \"926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5\": container with ID starting with 926051a6be4b74c9a86891ec6ee2c66b0fa057dde7eb3a75888bd9a44b4d9ec5 not found: ID does not exist"
Jul 30 20:23:47.748944 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.748934    2583 scope.go:117] "RemoveContainer" containerID="36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"
Jul 30 20:23:47.749214 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749188    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393"} err="failed to get container status \"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393\": rpc error: code = NotFound desc = could not find container \"36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393\": container with ID starting with 36882641ab808e3deeb784360b53c18b388a81561b1f8132bad57a57c6e14393 not found: ID does not exist"
Jul 30 20:23:47.749271 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749215    2583 scope.go:117] "RemoveContainer" containerID="66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"
Jul 30 20:23:47.749455 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749436    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86"} err="failed to get container status \"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86\": rpc error: code = NotFound desc = could not find container \"66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86\": container with ID starting with 66cc16319c1ae3fdaa33d0765e1250cc23310043c2dac415063e0937fd8eff86 not found: ID does not exist"
Jul 30 20:23:47.749510 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749456    2583 scope.go:117] "RemoveContainer" containerID="37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"
Jul 30 20:23:47.749742 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749712    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec"} err="failed to get container status \"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec\": rpc error: code = NotFound desc = could not find container \"37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec\": container with ID starting with 37cae20df073f71029010f38d3476decfd7b4cb7f98ac5f1f8cf6a046be62cec not found: ID does not exist"
Jul 30 20:23:47.749898 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.749744    2583 scope.go:117] "RemoveContainer" containerID="af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"
Jul 30 20:23:47.750105 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.750072    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55"} err="failed to get container status \"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55\": rpc error: code = NotFound desc = could not find container \"af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55\": container with ID starting with af8179068e32d841ddcf1278918c4f45a4e9595778992e2562973862af243f55 not found: ID does not exist"
Jul 30 20:23:47.750105 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.750101    2583 scope.go:117] "RemoveContainer" containerID="75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"
Jul 30 20:23:47.750421 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.750396    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533"} err="failed to get container status \"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533\": rpc error: code = NotFound desc = could not find container \"75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533\": container with ID starting with 75d0791f4b69d67644c9432a5588652cac4f8d351778d43da5dd63027dd23533 not found: ID does not exist"
Jul 30 20:23:47.751108 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751089    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 20:23:47.751184 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751093    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 20:23:47.751306 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751290    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 20:23:47.751382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 20:23:47.751382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751368    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 20:23:47.751479 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751454    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 20:23:47.751535 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 20:23:47.751577 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751557    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 20:23:47.751657 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.751639    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pxtpr\""
Jul 30 20:23:47.755541 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.755520    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 20:23:47.764589 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.764563    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:47.877500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877455    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.877671 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.877671 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.877802 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.877886 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.877947 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.877902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-web-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878082 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-out\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878144 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878349 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878443 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.878615 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.878592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9zkm\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-kube-api-access-p9zkm\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-out\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979385    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979751 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979751 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9zkm\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-kube-api-access-p9zkm\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979846 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.979846 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.979821    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.980365 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.980335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.980506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.980384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.980506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.980438    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.980506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.980465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.980506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.980493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-web-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-out\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982815 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982564    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.982815 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.982796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.983078 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.983027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.983158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.983121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-web-config\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.983397 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.983376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.983397 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.983387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.984200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.984183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:47.987112 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:47.987090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9zkm\" (UniqueName: \"kubernetes.io/projected/bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb-kube-api-access-p9zkm\") pod \"alertmanager-main-0\" (UID: \"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:48.059869 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.059831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 20:23:48.200547 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.200519    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 20:23:48.202502 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:23:48.202474    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5b5fb8_3d88_4dc4_89a2_0772aa0b03fb.slice/crio-da107f988818fdf4448a1c8275d61416058e85f114759f627e090ba04c23248f WatchSource:0}: Error finding container da107f988818fdf4448a1c8275d61416058e85f114759f627e090ba04c23248f: Status 404 returned error can't find the container with id da107f988818fdf4448a1c8275d61416058e85f114759f627e090ba04c23248f
Jul 30 20:23:48.695261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.695168    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb" containerID="b543b404309e61af138f32ae5cb614c8db22a1aab2df6e647295a94f679c7146" exitCode=0
Jul 30 20:23:48.695670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.695261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerDied","Data":"b543b404309e61af138f32ae5cb614c8db22a1aab2df6e647295a94f679c7146"}
Jul 30 20:23:48.695670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.695337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"da107f988818fdf4448a1c8275d61416058e85f114759f627e090ba04c23248f"}
Jul 30 20:23:48.753460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:48.753428    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc651826-54c4-447f-9204-b2dacbdf8cce" path="/var/lib/kubelet/pods/cc651826-54c4-447f-9204-b2dacbdf8cce/volumes"
Jul 30 20:23:49.702947 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.702912    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"9d12f4141dd11037e4e1207ddead7a6035a473d6c003f63035d061e6b20ebd99"}
Jul 30 20:23:49.703334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.702977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"123ea208f065df390c227b3ae404ca3f26effff4e6bca1f8721013c3514c36ae"}
Jul 30 20:23:49.703334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.703004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"7e880d37de18fedb98627c194464b53cf7a068f2fe0824ab3d2a998fef2597b9"}
Jul 30 20:23:49.703334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.703030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"7015849b2f460051376188d8606d54d9c2ff2abbe7b365ab7427822631fc8e8a"}
Jul 30 20:23:49.703334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.703052    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"7be2deae26ce4c045f5edd9a7950268ca635410f1001c0c9a58197f128364746"}
Jul 30 20:23:49.703334 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.703074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb","Type":"ContainerStarted","Data":"d3671b611e89ff3ac49750793ba80bb3c696a4547353219126febfb50766344f"}
Jul 30 20:23:49.732902 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:49.732846    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.716523858 podStartE2EDuration="2.73282826s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.304402ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:49.730328964 +0000 UTC m=+157.493249492" watchObservedRunningTime="2026-07-30 20:23:49.73282826 +0000 UTC m=+157.495748793"
Jul 30 20:23:50.352760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.352718    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:50.353181 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353144    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="prometheus" containerID="cri-o://571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572" gracePeriod=600
Jul 30 20:23:50.353181 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353163    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4" gracePeriod=600
Jul 30 20:23:50.353345 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353214    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-web" containerID="cri-o://3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7" gracePeriod=600
Jul 30 20:23:50.353345 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353311    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy" containerID="cri-o://750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468" gracePeriod=600
Jul 30 20:23:50.353345 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353326    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="config-reloader" containerID="cri-o://a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3" gracePeriod=600
Jul 30 20:23:50.353495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.353376    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="thanos-sidecar" containerID="cri-o://a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2" gracePeriod=600
Jul 30 20:23:50.715086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715052    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4" exitCode=0
Jul 30 20:23:50.715086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715077    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468" exitCode=0
Jul 30 20:23:50.715086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715085    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2" exitCode=0
Jul 30 20:23:50.715086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715091    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3" exitCode=0
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715099    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572" exitCode=0
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"}
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"}
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"}
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"}
Jul 30 20:23:50.715527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:50.715309    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"}
Jul 30 20:23:51.598569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.598544    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:51.714583 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714499    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc7dt\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714583 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714546    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714589    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714722    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.714825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714816    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714878    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714910    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714955    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.714977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715029    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715056    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715112    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715128    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.715474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715325    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out\") pod \"fc1ce85b-0346-4641-a65a-3634f0d99741\" (UID: \"fc1ce85b-0346-4641-a65a-3634f0d99741\") "
Jul 30 20:23:51.716089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715572    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.716089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715758    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.716089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.715778    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.716479 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.716412    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.716796 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.716769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.717613 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.717326    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.718061 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.717728    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.718061 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.717902    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.718302 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.718267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.718302 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.718278    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:23:51.718580 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.718548    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt" (OuterVolumeSpecName: "kube-api-access-jc7dt") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "kube-api-access-jc7dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:51.719216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.719146    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:51.720155 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.720113    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config" (OuterVolumeSpecName: "config") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.720266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.720151    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out" (OuterVolumeSpecName: "config-out") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:23:51.720474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.720447    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.720896 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.720874    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.721141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.721074    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:23:51.721141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.721075    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.721141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.721108    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.721360 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.721341    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.725382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.725264    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerID="3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7" exitCode=0
Jul 30 20:23:51.725382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.725321    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"}
Jul 30 20:23:51.725382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.725363    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:51.725545 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.725398    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fc1ce85b-0346-4641-a65a-3634f0d99741","Type":"ContainerDied","Data":"b85169187043e889eafe17e937d39084c486cc86a61366a3dc82e690c9cca56b"}
Jul 30 20:23:51.725545 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.725446    2583 scope.go:117] "RemoveContainer" containerID="1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"
Jul 30 20:23:51.733996 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.733970    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config" (OuterVolumeSpecName: "web-config") pod "fc1ce85b-0346-4641-a65a-3634f0d99741" (UID: "fc1ce85b-0346-4641-a65a-3634f0d99741"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:23:51.741037 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.741017    2583 scope.go:117] "RemoveContainer" containerID="750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"
Jul 30 20:23:51.748861 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.748844    2583 scope.go:117] "RemoveContainer" containerID="3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"
Jul 30 20:23:51.756301 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.756278    2583 scope.go:117] "RemoveContainer" containerID="a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"
Jul 30 20:23:51.763565 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.763545    2583 scope.go:117] "RemoveContainer" containerID="a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"
Jul 30 20:23:51.770640 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.770622    2583 scope.go:117] "RemoveContainer" containerID="571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"
Jul 30 20:23:51.778200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.778177    2583 scope.go:117] "RemoveContainer" containerID="8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31"
Jul 30 20:23:51.785235 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.785217    2583 scope.go:117] "RemoveContainer" containerID="1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"
Jul 30 20:23:51.785507 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.785487    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4\": container with ID starting with 1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4 not found: ID does not exist" containerID="1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"
Jul 30 20:23:51.785576 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.785516    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4"} err="failed to get container status \"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4\": rpc error: code = NotFound desc = could not find container \"1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4\": container with ID starting with 1544b685151562b35e8446f3ee41f1ab1505829b6b9dd97db7386caaa15178e4 not found: ID does not exist"
Jul 30 20:23:51.785576 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.785536    2583 scope.go:117] "RemoveContainer" containerID="750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"
Jul 30 20:23:51.785886 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.785868    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468\": container with ID starting with 750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468 not found: ID does not exist" containerID="750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"
Jul 30 20:23:51.785935 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.785895    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468"} err="failed to get container status \"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468\": rpc error: code = NotFound desc = could not find container \"750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468\": container with ID starting with 750baca9ebe2bd172a8d28cf74d45844bbb37e28addb8d6b02ff5fb6a2095468 not found: ID does not exist"
Jul 30 20:23:51.785935 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.785913    2583 scope.go:117] "RemoveContainer" containerID="3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"
Jul 30 20:23:51.786170 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.786152    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7\": container with ID starting with 3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7 not found: ID does not exist" containerID="3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"
Jul 30 20:23:51.786206 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786175    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7"} err="failed to get container status \"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7\": rpc error: code = NotFound desc = could not find container \"3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7\": container with ID starting with 3eb5a8b5a9113082263b0cc78ab2faa891fa1543d406edf703e9ba91fa149fc7 not found: ID does not exist"
Jul 30 20:23:51.786206 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786190    2583 scope.go:117] "RemoveContainer" containerID="a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"
Jul 30 20:23:51.786432 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.786416    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2\": container with ID starting with a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2 not found: ID does not exist" containerID="a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"
Jul 30 20:23:51.786492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786435    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2"} err="failed to get container status \"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2\": rpc error: code = NotFound desc = could not find container \"a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2\": container with ID starting with a8fcf171bab43a3f6f7c095cfb4aad28eb27186c31c06c467c4bd68c9c65b0d2 not found: ID does not exist"
Jul 30 20:23:51.786492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786448    2583 scope.go:117] "RemoveContainer" containerID="a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"
Jul 30 20:23:51.786675 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.786659    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3\": container with ID starting with a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3 not found: ID does not exist" containerID="a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"
Jul 30 20:23:51.786736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786696    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3"} err="failed to get container status \"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3\": rpc error: code = NotFound desc = could not find container \"a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3\": container with ID starting with a8b380efba9a9733292931e8bfe0f4555dc4a86c9dc858aff2810521cc4f81b3 not found: ID does not exist"
Jul 30 20:23:51.786736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786716    2583 scope.go:117] "RemoveContainer" containerID="571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"
Jul 30 20:23:51.786944 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.786926    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572\": container with ID starting with 571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572 not found: ID does not exist" containerID="571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"
Jul 30 20:23:51.786990 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786947    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572"} err="failed to get container status \"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572\": rpc error: code = NotFound desc = could not find container \"571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572\": container with ID starting with 571898b8f859a8abe70b98532b2cc3b6c849449b62353ac12f210e4ea05b1572 not found: ID does not exist"
Jul 30 20:23:51.786990 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.786961    2583 scope.go:117] "RemoveContainer" containerID="8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31"
Jul 30 20:23:51.787177 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:23:51.787163    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31\": container with ID starting with 8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31 not found: ID does not exist" containerID="8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31"
Jul 30 20:23:51.787215 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.787179    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31"} err="failed to get container status \"8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31\": rpc error: code = NotFound desc = could not find container \"8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31\": container with ID starting with 8346d943cfb40b60ad2b9429b709f2c63962f371352d9c1063131fbd45ab9b31 not found: ID does not exist"
Jul 30 20:23:51.816663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816628    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816663 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816659    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-config\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816670    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-tls-assets\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816680    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-kube-rbac-proxy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816708    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816717    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816725    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-metrics-client-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816736    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-web-config\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816743    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-config-out\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816751    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc7dt\" (UniqueName: \"kubernetes.io/projected/fc1ce85b-0346-4641-a65a-3634f0d99741-kube-api-access-jc7dt\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816762    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816771    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816780    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816789    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-metrics-client-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816798    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-db\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816806    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816814    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fc1ce85b-0346-4641-a65a-3634f0d99741-secret-grpc-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:51.816825 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:51.816822    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc1ce85b-0346-4641-a65a-3634f0d99741-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:23:52.051144 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.051109    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:52.055566 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.055540    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:52.079806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.079774    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:52.080115 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080101    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="prometheus"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080116    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="prometheus"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080126    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-thanos"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080132    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-thanos"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080141    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="config-reloader"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080147    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="config-reloader"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080155    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="init-config-reloader"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080160    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="init-config-reloader"
Jul 30 20:23:52.080168 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080169    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-web"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080175    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-web"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080182    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="thanos-sidecar"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080187    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="thanos-sidecar"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080200    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080204    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080252    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-web"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080259    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080266    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="config-reloader"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080272    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="thanos-sidecar"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080277    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="prometheus"
Jul 30 20:23:52.080474 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.080285    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" containerName="kube-rbac-proxy-thanos"
Jul 30 20:23:52.084063 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.084039    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.086822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.086788    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 20:23:52.087175 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087149    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 20:23:52.087285 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087149    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 20:23:52.087285 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 20:23:52.087424 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087291    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-95nabee0dr1qv\""
Jul 30 20:23:52.087489 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087458    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 20:23:52.087620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.087608    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 20:23:52.088200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088118    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m8gtp\""
Jul 30 20:23:52.088200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088137    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 20:23:52.088200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 20:23:52.088464 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088227    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 20:23:52.088464 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088329    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 20:23:52.088464 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088382    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 20:23:52.088908 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.088887    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 20:23:52.089959 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.089939    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 20:23:52.093498 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.093479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 20:23:52.099713 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.099670    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:52.221957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.221919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.221957 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.221955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.221977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.221996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222189 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222216    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gcx\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-kube-api-access-v7gcx\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.222515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.222460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gcx\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-kube-api-access-v7gcx\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323466    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323549    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.323620 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.324052 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.324052 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.324052 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.324052 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.323769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.324252 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.324197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.325284 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.324309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.325284 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.324581    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.325284 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.324868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.325284 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.324966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.325942 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.325887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.326648 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.326108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.326648 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.326480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.326648 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.326622    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.327355 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.326891    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.327355 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.327229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.327355 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.327298    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.328088 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.328065    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.328261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.328240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.328363 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.328268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.328531 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.328514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-config\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.328949 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.328931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.329156 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.329136    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b35137b-ed5a-4ec0-8035-24f27de8fc63-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.329267 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.329251    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b35137b-ed5a-4ec0-8035-24f27de8fc63-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.331784 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.331759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gcx\" (UniqueName: \"kubernetes.io/projected/6b35137b-ed5a-4ec0-8035-24f27de8fc63-kube-api-access-v7gcx\") pod \"prometheus-k8s-0\" (UID: \"6b35137b-ed5a-4ec0-8035-24f27de8fc63\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.395955 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.395920    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:23:52.538722 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.538678    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 20:23:52.539506 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:23:52.539479    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b35137b_ed5a_4ec0_8035_24f27de8fc63.slice/crio-f981234b094526004378b1884c45b7b6e9368acff23cb5bb6b0f35f189d43ddf WatchSource:0}: Error finding container f981234b094526004378b1884c45b7b6e9368acff23cb5bb6b0f35f189d43ddf: Status 404 returned error can't find the container with id f981234b094526004378b1884c45b7b6e9368acff23cb5bb6b0f35f189d43ddf
Jul 30 20:23:52.732446 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.732413    2583 generic.go:356] "Generic (PLEG): container finished" podID="6b35137b-ed5a-4ec0-8035-24f27de8fc63" containerID="4c59c9a27d01e2fd6e36c741b1f50bb48ab1c871c19a340cdd8b76bad33a1f02" exitCode=0
Jul 30 20:23:52.732948 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.732508    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerDied","Data":"4c59c9a27d01e2fd6e36c741b1f50bb48ab1c871c19a340cdd8b76bad33a1f02"}
Jul 30 20:23:52.732948 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.732611    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"f981234b094526004378b1884c45b7b6e9368acff23cb5bb6b0f35f189d43ddf"}
Jul 30 20:23:52.755319 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:52.755286    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1ce85b-0346-4641-a65a-3634f0d99741" path="/var/lib/kubelet/pods/fc1ce85b-0346-4641-a65a-3634f0d99741/volumes"
Jul 30 20:23:53.744025 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.743983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"5547d72c291bf0229b4cc1ab9f50cdfb58f2ac5682b58ec3e9e4ffd5879d2362"}
Jul 30 20:23:53.744403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.744106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"c03bd4d75874132ed11f9f072922448bbc322ce100438f94fe6219a7bc2b4cfa"}
Jul 30 20:23:53.744403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.744155    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"9588f3817287adc3a34331292877709405b2cbb8a3355338a295401fbf41f42a"}
Jul 30 20:23:53.744403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.744192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"88d636aed0c13d63e544d0c2d372fa5e7b84be1f1668ec0d8b1c5bafed53f365"}
Jul 30 20:23:53.744403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.744228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"80956ac83ecc56c17c1822fe5f8e7a932b46fc538738937993e0ae661e777e6a"}
Jul 30 20:23:53.744403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.744262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b35137b-ed5a-4ec0-8035-24f27de8fc63","Type":"ContainerStarted","Data":"cc7f0c22dada7c3194367121b983940af455d65d30d9acd8f148c99d4f8a189e"}
Jul 30 20:23:53.773318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:53.773245    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.753668781 podStartE2EDuration="1.773222299s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.553518ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:23:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:23:53.770811245 +0000 UTC m=+161.533731780" watchObservedRunningTime="2026-07-30 20:23:53.773222299 +0000 UTC m=+161.536142834"
Jul 30 20:23:57.396644 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:23:57.396587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:24:52.396538 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:24:52.396486    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:24:52.412786 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:24:52.412757    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:24:53.002933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:24:53.002901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 20:25:10.967491 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.967451    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"]
Jul 30 20:25:10.969746 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.969727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:10.972135 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.972111    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 20:25:10.973369 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.973349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bjsvb\""
Jul 30 20:25:10.973459 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.973395    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 20:25:10.978147 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:10.978121    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"]
Jul 30 20:25:11.039634 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.039601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8wtt\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-kube-api-access-p8wtt\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.039809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.039668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.141081 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.141039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.141278 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.141226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8wtt\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-kube-api-access-p8wtt\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.149000 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.148969    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.149139 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.149042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8wtt\" (UniqueName: \"kubernetes.io/projected/3dd9d089-deda-4dd9-b80e-594b0d1d87ee-kube-api-access-p8wtt\") pod \"cert-manager-cainjector-559cdd8c87-r8shz\" (UID: \"3dd9d089-deda-4dd9-b80e-594b0d1d87ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.294227 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.294183    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"
Jul 30 20:25:11.453054 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:11.453010    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-r8shz"]
Jul 30 20:25:11.458092 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:25:11.458058    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dd9d089_deda_4dd9_b80e_594b0d1d87ee.slice/crio-c90be27b38f1b0f211bf0ecff9c5ee2aaefcfaf91bd5c6f695208547632866c7 WatchSource:0}: Error finding container c90be27b38f1b0f211bf0ecff9c5ee2aaefcfaf91bd5c6f695208547632866c7: Status 404 returned error can't find the container with id c90be27b38f1b0f211bf0ecff9c5ee2aaefcfaf91bd5c6f695208547632866c7
Jul 30 20:25:12.069245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:12.069209    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz" event={"ID":"3dd9d089-deda-4dd9-b80e-594b0d1d87ee","Type":"ContainerStarted","Data":"c90be27b38f1b0f211bf0ecff9c5ee2aaefcfaf91bd5c6f695208547632866c7"}
Jul 30 20:25:15.087009 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:15.086973    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz" event={"ID":"3dd9d089-deda-4dd9-b80e-594b0d1d87ee","Type":"ContainerStarted","Data":"11cdaaf6f8522857ed6af2689e70586ea898a7f8eb20b338babf9c5ed49946b6"}
Jul 30 20:25:15.106594 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:15.106542    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-r8shz" podStartSLOduration=2.011230082 podStartE2EDuration="5.106524263s" totalImagesPullingTime="3.095294181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:15.10629722 +0000 UTC m=+242.869217754" watchObservedRunningTime="2026-07-30 20:25:15.106524263 +0000 UTC m=+242.869444797"
Jul 30 20:25:37.799000 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.798911    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"]
Jul 30 20:25:37.801430 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.801406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:37.804217 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.804195    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 20:25:37.805450 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.805430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 20:25:37.805569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.805452    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8hnzv\""
Jul 30 20:25:37.805569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.805475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 20:25:37.805569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.805434    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 20:25:37.805569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.805434    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 20:25:37.814495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.814471    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"]
Jul 30 20:25:37.980216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.980183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-manager-config\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:37.980394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.980247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wgxm\" (UniqueName: \"kubernetes.io/projected/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-kube-api-access-6wgxm\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:37.980394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.980273    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-metrics-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:37.980394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:37.980305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.081485 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.081400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.081485 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.081449    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-manager-config\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.081671 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.081491    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wgxm\" (UniqueName: \"kubernetes.io/projected/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-kube-api-access-6wgxm\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.081671 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.081513    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-metrics-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.082195 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.082166    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-manager-config\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.083890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.083865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.084077 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.084059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-metrics-cert\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.090844 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.090817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wgxm\" (UniqueName: \"kubernetes.io/projected/ae59661a-5de4-4ca9-b78d-ec9442d8f77b-kube-api-access-6wgxm\") pod \"lws-controller-manager-696d745bf6-j7mkw\" (UID: \"ae59661a-5de4-4ca9-b78d-ec9442d8f77b\") " pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.110862 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.110830    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:38.250785 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:38.250749    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"]
Jul 30 20:25:38.254052 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:25:38.254023    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae59661a_5de4_4ca9_b78d_ec9442d8f77b.slice/crio-798bbb20a5498f6521e5c670920136ce4398e46c6137d843659ae25d31382ff1 WatchSource:0}: Error finding container 798bbb20a5498f6521e5c670920136ce4398e46c6137d843659ae25d31382ff1: Status 404 returned error can't find the container with id 798bbb20a5498f6521e5c670920136ce4398e46c6137d843659ae25d31382ff1
Jul 30 20:25:39.192493 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:39.192454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw" event={"ID":"ae59661a-5de4-4ca9-b78d-ec9442d8f77b","Type":"ContainerStarted","Data":"798bbb20a5498f6521e5c670920136ce4398e46c6137d843659ae25d31382ff1"}
Jul 30 20:25:41.204742 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.204668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw" event={"ID":"ae59661a-5de4-4ca9-b78d-ec9442d8f77b","Type":"ContainerStarted","Data":"a244d7fa22c50a3c313997eb209f51f1c9e42b4f2c821fd2bdcef9315e89dea3"}
Jul 30 20:25:41.205128 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.204756    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:41.220649 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.220589    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw" podStartSLOduration=2.072625795 podStartE2EDuration="4.220570882s" totalImagesPullingTime="2.147945087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:41.220066385 +0000 UTC m=+268.982986932" watchObservedRunningTime="2026-07-30 20:25:41.220570882 +0000 UTC m=+268.983491417"
Jul 30 20:25:41.992645 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.992607    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"]
Jul 30 20:25:41.995375 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.995348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:41.999028 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.999002    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 20:25:42.001330 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.999297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 20:25:42.001330 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.999312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 20:25:42.001330 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.999567    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 20:25:42.001330 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:41.999871    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wcr5p\""
Jul 30 20:25:42.013425 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.013390    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"]
Jul 30 20:25:42.120867 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.120827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-manifests\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.120867 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.120871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-tmp\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.121104 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.121001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.121104 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.121045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszbx\" (UniqueName: \"kubernetes.io/projected/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-kube-api-access-tszbx\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.121233 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.121123    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.222499 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-manifests\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.222499 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-tmp\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.223088 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.223088 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszbx\" (UniqueName: \"kubernetes.io/projected/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-kube-api-access-tszbx\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.223088 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.223088 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.222917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-manifests\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.224800 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.224771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-tmp\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.225105 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.225075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.225149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.225135    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.231868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.231845    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszbx\" (UniqueName: \"kubernetes.io/projected/e08c92d4-dcd4-4597-a979-5e0e94f4da5c-kube-api-access-tszbx\") pod \"opendatahub-operator-controller-manager-58fb4f68b-sf8qp\" (UID: \"e08c92d4-dcd4-4597-a979-5e0e94f4da5c\") " pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.308668 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.308586    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:42.476971 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:42.476942    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"]
Jul 30 20:25:42.479024 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:25:42.478993    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08c92d4_dcd4_4597_a979_5e0e94f4da5c.slice/crio-6b92fb9276f085444a7f2a61aa5504af075a545dedb5df10db52a99918f32ac5 WatchSource:0}: Error finding container 6b92fb9276f085444a7f2a61aa5504af075a545dedb5df10db52a99918f32ac5: Status 404 returned error can't find the container with id 6b92fb9276f085444a7f2a61aa5504af075a545dedb5df10db52a99918f32ac5
Jul 30 20:25:43.215900 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:43.215861    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp" event={"ID":"e08c92d4-dcd4-4597-a979-5e0e94f4da5c","Type":"ContainerStarted","Data":"6b92fb9276f085444a7f2a61aa5504af075a545dedb5df10db52a99918f32ac5"}
Jul 30 20:25:46.232635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:46.232601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp" event={"ID":"e08c92d4-dcd4-4597-a979-5e0e94f4da5c","Type":"ContainerStarted","Data":"cdf969a9aea63c6ec83eed8d3ff5f950962f19a75f870efc785709062b48544c"}
Jul 30 20:25:47.241963 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:47.241928    2583 generic.go:356] "Generic (PLEG): container finished" podID="e08c92d4-dcd4-4597-a979-5e0e94f4da5c" containerID="cdf969a9aea63c6ec83eed8d3ff5f950962f19a75f870efc785709062b48544c" exitCode=0
Jul 30 20:25:47.242345 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:47.242008    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp" event={"ID":"e08c92d4-dcd4-4597-a979-5e0e94f4da5c","Type":"ContainerDied","Data":"cdf969a9aea63c6ec83eed8d3ff5f950962f19a75f870efc785709062b48544c"}
Jul 30 20:25:48.248728 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:48.248668    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp" event={"ID":"e08c92d4-dcd4-4597-a979-5e0e94f4da5c","Type":"ContainerStarted","Data":"20dce07392af968d4e8c238cfded98d8d6eda1ea1ac97c31509375985597f892"}
Jul 30 20:25:48.249164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:48.248808    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:25:48.272576 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:48.272520    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp" podStartSLOduration=2.596015792 podStartE2EDuration="7.272505449s" totalImagesPullingTime="3.649640988s" totalInitContainerRuntime="1.026848669s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:25:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:25:48.270721866 +0000 UTC m=+276.033642400" watchObservedRunningTime="2026-07-30 20:25:48.272505449 +0000 UTC m=+276.035425983"
Jul 30 20:25:52.211299 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:52.211269    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-696d745bf6-j7mkw"
Jul 30 20:25:59.255182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:25:59.255148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58fb4f68b-sf8qp"
Jul 30 20:26:01.338382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.338341    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"]
Jul 30 20:26:01.351786 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.351750    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.356872 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.356845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 20:26:01.356872 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.356845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 20:26:01.357100 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.356886    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 20:26:01.357100 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.356885    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 20:26:01.358087 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.358064    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cq7sc\""
Jul 30 20:26:01.369196 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.369160    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"]
Jul 30 20:26:01.409636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.409597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tmp\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.409851 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.409669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w26ff\" (UniqueName: \"kubernetes.io/projected/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-kube-api-access-w26ff\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.409851 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.409736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tls-certs\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.511018 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.510965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tmp\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.511192 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.511047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w26ff\" (UniqueName: \"kubernetes.io/projected/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-kube-api-access-w26ff\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.511192 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.511077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tls-certs\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.513279 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.513256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tmp\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.513500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.513469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-tls-certs\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.526561 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.526531    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w26ff\" (UniqueName: \"kubernetes.io/projected/b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab-kube-api-access-w26ff\") pod \"kube-auth-proxy-55c4ff7d78-gj8cm\" (UID: \"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab\") " pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.661844 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.661756    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"
Jul 30 20:26:01.816787 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:01.816644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm"]
Jul 30 20:26:01.819437 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:26:01.819409    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d1ce8c_c86d_44a9_b6c7_c4d4d8eac9ab.slice/crio-01c1ba2cc00476221a2d6f8fb811f9d07343deef7af615bbd542288e84845e76 WatchSource:0}: Error finding container 01c1ba2cc00476221a2d6f8fb811f9d07343deef7af615bbd542288e84845e76: Status 404 returned error can't find the container with id 01c1ba2cc00476221a2d6f8fb811f9d07343deef7af615bbd542288e84845e76
Jul 30 20:26:02.314615 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:02.314579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm" event={"ID":"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab","Type":"ContainerStarted","Data":"01c1ba2cc00476221a2d6f8fb811f9d07343deef7af615bbd542288e84845e76"}
Jul 30 20:26:05.332670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:05.332629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm" event={"ID":"b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab","Type":"ContainerStarted","Data":"d471855e5f2e470374f03afa2e3166d4f12a037b70a83ab62d440a3677bec58c"}
Jul 30 20:26:05.351274 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:05.351225    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55c4ff7d78-gj8cm" podStartSLOduration=1.7609255560000001 podStartE2EDuration="4.351207544s" totalImagesPullingTime="2.590281988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:26:05.349739405 +0000 UTC m=+293.112659949" watchObservedRunningTime="2026-07-30 20:26:05.351207544 +0000 UTC m=+293.114128077"
Jul 30 20:26:12.622705 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:26:12.622653    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 20:27:31.467973 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.467935    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-msk29"]
Jul 30 20:27:31.470412 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.470392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:31.473050 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.473022    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 20:27:31.473182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.473047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 20:27:31.473182 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.473062    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qjq8j\""
Jul 30 20:27:31.481117 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.481091    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-msk29"]
Jul 30 20:27:31.545963 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.545904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7665s\" (UniqueName: \"kubernetes.io/projected/5afb0569-cec5-4bef-8076-2686be32ed44-kube-api-access-7665s\") pod \"authorino-operator-68d88948d8-msk29\" (UID: \"5afb0569-cec5-4bef-8076-2686be32ed44\") " pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:31.647236 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.647200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7665s\" (UniqueName: \"kubernetes.io/projected/5afb0569-cec5-4bef-8076-2686be32ed44-kube-api-access-7665s\") pod \"authorino-operator-68d88948d8-msk29\" (UID: \"5afb0569-cec5-4bef-8076-2686be32ed44\") " pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:31.659927 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.659887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7665s\" (UniqueName: \"kubernetes.io/projected/5afb0569-cec5-4bef-8076-2686be32ed44-kube-api-access-7665s\") pod \"authorino-operator-68d88948d8-msk29\" (UID: \"5afb0569-cec5-4bef-8076-2686be32ed44\") " pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:31.782087 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.782043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:31.924298 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.924271    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-msk29"]
Jul 30 20:27:31.926415 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:27:31.926387    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afb0569_cec5_4bef_8076_2686be32ed44.slice/crio-1b8e4e41d72c18731dd7543fff3dc9ef43fc7442d50dfcac29cab1fd50651239 WatchSource:0}: Error finding container 1b8e4e41d72c18731dd7543fff3dc9ef43fc7442d50dfcac29cab1fd50651239: Status 404 returned error can't find the container with id 1b8e4e41d72c18731dd7543fff3dc9ef43fc7442d50dfcac29cab1fd50651239
Jul 30 20:27:31.928770 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:31.928750    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:27:32.736477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:32.736445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-msk29" event={"ID":"5afb0569-cec5-4bef-8076-2686be32ed44","Type":"ContainerStarted","Data":"1b8e4e41d72c18731dd7543fff3dc9ef43fc7442d50dfcac29cab1fd50651239"}
Jul 30 20:27:34.754231 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:34.754195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:27:34.754607 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:34.754245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-msk29" event={"ID":"5afb0569-cec5-4bef-8076-2686be32ed44","Type":"ContainerStarted","Data":"1ecf288bec853452f10877a356bd26b10b75e613a593f2a35dc4358a229e9d5a"}
Jul 30 20:27:34.772448 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:34.772390    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-msk29" podStartSLOduration=1.246938528 podStartE2EDuration="3.772372835s" totalImagesPullingTime="2.525434307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:27:34.770770773 +0000 UTC m=+382.533691310" watchObservedRunningTime="2026-07-30 20:27:34.772372835 +0000 UTC m=+382.535293369"
Jul 30 20:27:45.757566 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:27:45.757533    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-msk29"
Jul 30 20:28:15.728448 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.728411    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:15.736508 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.736477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:15.738859 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.738834    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:15.739355 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.739333    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-grtts\""
Jul 30 20:28:15.839598 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.839558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xv9d\" (UniqueName: \"kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d\") pod \"authorino-b54df94b4-bkr6r\" (UID: \"4614f927-248d-448c-a5c3-3a47061b0772\") " pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:15.940101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.940068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xv9d\" (UniqueName: \"kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d\") pod \"authorino-b54df94b4-bkr6r\" (UID: \"4614f927-248d-448c-a5c3-3a47061b0772\") " pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:15.954298 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.954265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xv9d\" (UniqueName: \"kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d\") pod \"authorino-b54df94b4-bkr6r\" (UID: \"4614f927-248d-448c-a5c3-3a47061b0772\") " pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:15.969621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.969590    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:15.973437 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.973418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:15.986123 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:15.986097    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:16.040807 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.040763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb785\" (UniqueName: \"kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785\") pod \"authorino-c548b5d7d-4z9tg\" (UID: \"53d30de5-71be-427a-a7ab-1c38621dd340\") " pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:16.048605 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.048577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:16.141897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.141868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb785\" (UniqueName: \"kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785\") pod \"authorino-c548b5d7d-4z9tg\" (UID: \"53d30de5-71be-427a-a7ab-1c38621dd340\") " pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:16.152524 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.152491    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb785\" (UniqueName: \"kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785\") pod \"authorino-c548b5d7d-4z9tg\" (UID: \"53d30de5-71be-427a-a7ab-1c38621dd340\") " pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:16.184990 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.184963    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:16.187582 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:28:16.187549    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4614f927_248d_448c_a5c3_3a47061b0772.slice/crio-eee4a24483b6ec5639a380e32260472e0dc46b56007bd975643b67d8e96381e9 WatchSource:0}: Error finding container eee4a24483b6ec5639a380e32260472e0dc46b56007bd975643b67d8e96381e9: Status 404 returned error can't find the container with id eee4a24483b6ec5639a380e32260472e0dc46b56007bd975643b67d8e96381e9
Jul 30 20:28:16.282855 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.282764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:16.418833 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.418811    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:16.420963 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:28:16.420934    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53d30de5_71be_427a_a7ab_1c38621dd340.slice/crio-b4da34fc60212a6219edb0687d68cabe02d6514194cb43b41b2d706ea4445873 WatchSource:0}: Error finding container b4da34fc60212a6219edb0687d68cabe02d6514194cb43b41b2d706ea4445873: Status 404 returned error can't find the container with id b4da34fc60212a6219edb0687d68cabe02d6514194cb43b41b2d706ea4445873
Jul 30 20:28:16.942871 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.942835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bkr6r" event={"ID":"4614f927-248d-448c-a5c3-3a47061b0772","Type":"ContainerStarted","Data":"eee4a24483b6ec5639a380e32260472e0dc46b56007bd975643b67d8e96381e9"}
Jul 30 20:28:16.944089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:16.944067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" event={"ID":"53d30de5-71be-427a-a7ab-1c38621dd340","Type":"ContainerStarted","Data":"b4da34fc60212a6219edb0687d68cabe02d6514194cb43b41b2d706ea4445873"}
Jul 30 20:28:18.959550 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:18.959455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bkr6r" event={"ID":"4614f927-248d-448c-a5c3-3a47061b0772","Type":"ContainerStarted","Data":"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"}
Jul 30 20:28:18.961058 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:18.961028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" event={"ID":"53d30de5-71be-427a-a7ab-1c38621dd340","Type":"ContainerStarted","Data":"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"}
Jul 30 20:28:18.975547 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:18.975495    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-bkr6r" podStartSLOduration=1.6466208199999999 podStartE2EDuration="3.975480226s" totalImagesPullingTime="2.328859406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:28:18.973483294 +0000 UTC m=+426.736403827" watchObservedRunningTime="2026-07-30 20:28:18.975480226 +0000 UTC m=+426.738400759"
Jul 30 20:28:18.988078 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:18.988029    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" podStartSLOduration=1.881192681 podStartE2EDuration="3.988016452s" totalImagesPullingTime="2.106823771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:28:18.987745025 +0000 UTC m=+426.750665557" watchObservedRunningTime="2026-07-30 20:28:18.988016452 +0000 UTC m=+426.750936989"
Jul 30 20:28:19.015014 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:19.014972    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:20.970531 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:20.970490    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-bkr6r" podUID="4614f927-248d-448c-a5c3-3a47061b0772" containerName="authorino" containerID="cri-o://9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c" gracePeriod=30
Jul 30 20:28:21.222343 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.222282    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:21.287002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.286962    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xv9d\" (UniqueName: \"kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d\") pod \"4614f927-248d-448c-a5c3-3a47061b0772\" (UID: \"4614f927-248d-448c-a5c3-3a47061b0772\") "
Jul 30 20:28:21.289175 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.289139    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d" (OuterVolumeSpecName: "kube-api-access-7xv9d") pod "4614f927-248d-448c-a5c3-3a47061b0772" (UID: "4614f927-248d-448c-a5c3-3a47061b0772"). InnerVolumeSpecName "kube-api-access-7xv9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:28:21.387929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.387894    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xv9d\" (UniqueName: \"kubernetes.io/projected/4614f927-248d-448c-a5c3-3a47061b0772-kube-api-access-7xv9d\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:28:21.976010 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.975971    2583 generic.go:356] "Generic (PLEG): container finished" podID="4614f927-248d-448c-a5c3-3a47061b0772" containerID="9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c" exitCode=0
Jul 30 20:28:21.976010 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.976013    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-bkr6r"
Jul 30 20:28:21.976473 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.976022    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bkr6r" event={"ID":"4614f927-248d-448c-a5c3-3a47061b0772","Type":"ContainerDied","Data":"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"}
Jul 30 20:28:21.976473 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.976060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-bkr6r" event={"ID":"4614f927-248d-448c-a5c3-3a47061b0772","Type":"ContainerDied","Data":"eee4a24483b6ec5639a380e32260472e0dc46b56007bd975643b67d8e96381e9"}
Jul 30 20:28:21.976473 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.976084    2583 scope.go:117] "RemoveContainer" containerID="9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"
Jul 30 20:28:21.984969 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.984949    2583 scope.go:117] "RemoveContainer" containerID="9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"
Jul 30 20:28:21.985288 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:28:21.985266    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c\": container with ID starting with 9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c not found: ID does not exist" containerID="9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"
Jul 30 20:28:21.985329 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.985299    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c"} err="failed to get container status \"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c\": rpc error: code = NotFound desc = could not find container \"9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c\": container with ID starting with 9686a0feebb568c464be6bf1d77f274f4ffff0d2bfa226a5d910a4f2048d920c not found: ID does not exist"
Jul 30 20:28:21.996596 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:21.996566    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:22.000419 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:22.000395    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-bkr6r"]
Jul 30 20:28:22.753943 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:22.753911    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4614f927-248d-448c-a5c3-3a47061b0772" path="/var/lib/kubelet/pods/4614f927-248d-448c-a5c3-3a47061b0772/volumes"
Jul 30 20:28:43.983596 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.983520    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-qlkmf"]
Jul 30 20:28:43.983964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.983935    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4614f927-248d-448c-a5c3-3a47061b0772" containerName="authorino"
Jul 30 20:28:43.983964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.983947    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4614f927-248d-448c-a5c3-3a47061b0772" containerName="authorino"
Jul 30 20:28:43.984092 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.984010    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4614f927-248d-448c-a5c3-3a47061b0772" containerName="authorino"
Jul 30 20:28:43.987051 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.987030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:43.989457 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.989436    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 20:28:43.995770 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:43.995744    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-qlkmf"]
Jul 30 20:28:44.089563 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.089526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmkp6\" (UniqueName: \"kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.089771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.089644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.154697 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.154654    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-qlkmf"]
Jul 30 20:28:44.154977 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:28:44.154959    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hmkp6 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-qlkmf" podUID="0c02c430-0734-47ea-9027-15eaa9b891f4"
Jul 30 20:28:44.181805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.181763    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:28:44.185256 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.185232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.190327 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.190289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.190480 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.190335    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m4ds\" (UniqueName: \"kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.190480 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.190371    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.190480 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.190457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmkp6\" (UniqueName: \"kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.192497 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.192470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:28:44.193585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.193563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.198163 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.198128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmkp6\" (UniqueName: \"kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6\") pod \"authorino-687bd45585-qlkmf\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") " pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:44.291735 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.291613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.291898 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.291769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m4ds\" (UniqueName: \"kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.294100 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.294077    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.300116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.300086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m4ds\" (UniqueName: \"kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds\") pod \"authorino-7ff5b686c6-2rrt5\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") " pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.511378 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.511341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:28:44.646959 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:44.646922    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:28:44.649399 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:28:44.649371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe8a54dc_2ece_409f_8db3_5fe8840b783d.slice/crio-1dd369cea7faf419235854b4778040c7db9c1534c2dce8d65bf380d2fa3b1fcd WatchSource:0}: Error finding container 1dd369cea7faf419235854b4778040c7db9c1534c2dce8d65bf380d2fa3b1fcd: Status 404 returned error can't find the container with id 1dd369cea7faf419235854b4778040c7db9c1534c2dce8d65bf380d2fa3b1fcd
Jul 30 20:28:45.089050 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.089014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:45.089478 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.089016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" event={"ID":"fe8a54dc-2ece-409f-8db3-5fe8840b783d","Type":"ContainerStarted","Data":"1dd369cea7faf419235854b4778040c7db9c1534c2dce8d65bf380d2fa3b1fcd"}
Jul 30 20:28:45.097402 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.097378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:45.200136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.200102    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmkp6\" (UniqueName: \"kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6\") pod \"0c02c430-0734-47ea-9027-15eaa9b891f4\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") "
Jul 30 20:28:45.200312 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.200232    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert\") pod \"0c02c430-0734-47ea-9027-15eaa9b891f4\" (UID: \"0c02c430-0734-47ea-9027-15eaa9b891f4\") "
Jul 30 20:28:45.202303 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.202274    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0c02c430-0734-47ea-9027-15eaa9b891f4" (UID: "0c02c430-0734-47ea-9027-15eaa9b891f4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:28:45.202422 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.202346    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6" (OuterVolumeSpecName: "kube-api-access-hmkp6") pod "0c02c430-0734-47ea-9027-15eaa9b891f4" (UID: "0c02c430-0734-47ea-9027-15eaa9b891f4"). InnerVolumeSpecName "kube-api-access-hmkp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:28:45.301323 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.301288    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0c02c430-0734-47ea-9027-15eaa9b891f4-tls-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:28:45.301323 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:45.301317    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmkp6\" (UniqueName: \"kubernetes.io/projected/0c02c430-0734-47ea-9027-15eaa9b891f4-kube-api-access-hmkp6\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:28:46.101312 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.101273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" event={"ID":"fe8a54dc-2ece-409f-8db3-5fe8840b783d","Type":"ContainerStarted","Data":"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"}
Jul 30 20:28:46.101838 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.101360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-qlkmf"
Jul 30 20:28:46.118153 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.118100    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" podStartSLOduration=1.44439385 podStartE2EDuration="2.118084438s" totalImagesPullingTime="673.690588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:28:46.116551516 +0000 UTC m=+453.879472051" watchObservedRunningTime="2026-07-30 20:28:46.118084438 +0000 UTC m=+453.881004993"
Jul 30 20:28:46.139521 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.139486    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-qlkmf"]
Jul 30 20:28:46.143015 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.142984    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:46.143246 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.143221    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" podUID="53d30de5-71be-427a-a7ab-1c38621dd340" containerName="authorino" containerID="cri-o://a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c" gracePeriod=30
Jul 30 20:28:46.144899 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.144865    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-qlkmf"]
Jul 30 20:28:46.385802 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.385779    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:46.412484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.412451    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb785\" (UniqueName: \"kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785\") pod \"53d30de5-71be-427a-a7ab-1c38621dd340\" (UID: \"53d30de5-71be-427a-a7ab-1c38621dd340\") "
Jul 30 20:28:46.414614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.414583    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785" (OuterVolumeSpecName: "kube-api-access-zb785") pod "53d30de5-71be-427a-a7ab-1c38621dd340" (UID: "53d30de5-71be-427a-a7ab-1c38621dd340"). InnerVolumeSpecName "kube-api-access-zb785". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:28:46.514269 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.514230    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb785\" (UniqueName: \"kubernetes.io/projected/53d30de5-71be-427a-a7ab-1c38621dd340-kube-api-access-zb785\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:28:46.753850 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:46.753817    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c02c430-0734-47ea-9027-15eaa9b891f4" path="/var/lib/kubelet/pods/0c02c430-0734-47ea-9027-15eaa9b891f4/volumes"
Jul 30 20:28:47.107608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.107512    2583 generic.go:356] "Generic (PLEG): container finished" podID="53d30de5-71be-427a-a7ab-1c38621dd340" containerID="a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c" exitCode=0
Jul 30 20:28:47.107608 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.107553    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-4z9tg"
Jul 30 20:28:47.108152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.107602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" event={"ID":"53d30de5-71be-427a-a7ab-1c38621dd340","Type":"ContainerDied","Data":"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"}
Jul 30 20:28:47.108152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.107649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-4z9tg" event={"ID":"53d30de5-71be-427a-a7ab-1c38621dd340","Type":"ContainerDied","Data":"b4da34fc60212a6219edb0687d68cabe02d6514194cb43b41b2d706ea4445873"}
Jul 30 20:28:47.108152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.107671    2583 scope.go:117] "RemoveContainer" containerID="a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"
Jul 30 20:28:47.116151 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.116124    2583 scope.go:117] "RemoveContainer" containerID="a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"
Jul 30 20:28:47.116402 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:28:47.116382    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c\": container with ID starting with a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c not found: ID does not exist" containerID="a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"
Jul 30 20:28:47.116464 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.116411    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c"} err="failed to get container status \"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c\": rpc error: code = NotFound desc = could not find container \"a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c\": container with ID starting with a087a35c8f1f34580c69e1e7c9a747084783ef027fe6c46fba010fc5d9dc5c9c not found: ID does not exist"
Jul 30 20:28:47.145882 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.145849    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:47.150589 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:47.150561    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-4z9tg"]
Jul 30 20:28:48.754243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:28:48.754211    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53d30de5-71be-427a-a7ab-1c38621dd340" path="/var/lib/kubelet/pods/53d30de5-71be-427a-a7ab-1c38621dd340/volumes"
Jul 30 20:29:27.158456 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.158420    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"]
Jul 30 20:29:27.158888 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.158866    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d30de5-71be-427a-a7ab-1c38621dd340" containerName="authorino"
Jul 30 20:29:27.158888 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.158878    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d30de5-71be-427a-a7ab-1c38621dd340" containerName="authorino"
Jul 30 20:29:27.158965 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.158940    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d30de5-71be-427a-a7ab-1c38621dd340" containerName="authorino"
Jul 30 20:29:27.163426 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.163409    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.166301 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.166279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wbqnl\""
Jul 30 20:29:27.166301 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.166294    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 20:29:27.166477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.166302    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 20:29:27.167568 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.167546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 20:29:27.170380 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.170353    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"]
Jul 30 20:29:27.177878 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.177854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbngk\" (UniqueName: \"kubernetes.io/projected/e98b4a90-d467-400f-8fcd-96c1c391752b-kube-api-access-tbngk\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.178017 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.177890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e98b4a90-d467-400f-8fcd-96c1c391752b-openshift-service-ca\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.178017 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.177977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.278938 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.278905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.279115 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.279039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbngk\" (UniqueName: \"kubernetes.io/projected/e98b4a90-d467-400f-8fcd-96c1c391752b-kube-api-access-tbngk\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.279115 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:29:27.279077    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 30 20:29:27.279201 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:29:27.279144    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls podName:e98b4a90-d467-400f-8fcd-96c1c391752b nodeName:}" failed. No retries permitted until 2026-07-30 20:29:27.779121349 +0000 UTC m=+495.542041865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls") pod "maas-api-7cf66f64b9-m9npl" (UID: "e98b4a90-d467-400f-8fcd-96c1c391752b") : secret "maas-api-serving-cert" not found
Jul 30 20:29:27.279201 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.279079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e98b4a90-d467-400f-8fcd-96c1c391752b-openshift-service-ca\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.279745 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.279728    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e98b4a90-d467-400f-8fcd-96c1c391752b-openshift-service-ca\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.290748 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.290717    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbngk\" (UniqueName: \"kubernetes.io/projected/e98b4a90-d467-400f-8fcd-96c1c391752b-kube-api-access-tbngk\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.782729 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.782670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:27.785063 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:27.785044    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e98b4a90-d467-400f-8fcd-96c1c391752b-maas-api-tls\") pod \"maas-api-7cf66f64b9-m9npl\" (UID: \"e98b4a90-d467-400f-8fcd-96c1c391752b\") " pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:28.074954 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:28.074869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:28.209764 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:28.209738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"]
Jul 30 20:29:28.212512 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:29:28.212485    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98b4a90_d467_400f_8fcd_96c1c391752b.slice/crio-74bf9ce2742fa5c6a1f7c91c2323ad84e68a26b46dd8cad302be3c1babcb2757 WatchSource:0}: Error finding container 74bf9ce2742fa5c6a1f7c91c2323ad84e68a26b46dd8cad302be3c1babcb2757: Status 404 returned error can't find the container with id 74bf9ce2742fa5c6a1f7c91c2323ad84e68a26b46dd8cad302be3c1babcb2757
Jul 30 20:29:28.315273 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:28.315230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl" event={"ID":"e98b4a90-d467-400f-8fcd-96c1c391752b","Type":"ContainerStarted","Data":"74bf9ce2742fa5c6a1f7c91c2323ad84e68a26b46dd8cad302be3c1babcb2757"}
Jul 30 20:29:31.332760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:31.332716    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl" event={"ID":"e98b4a90-d467-400f-8fcd-96c1c391752b","Type":"ContainerStarted","Data":"91c5cbd3e70fb8f5eb15aa6bae23550739258f4193897e0c059d034ccc62518d"}
Jul 30 20:29:31.333237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:31.332796    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:31.349914 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:31.349860    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl" podStartSLOduration=1.970358907 podStartE2EDuration="4.349844369s" totalImagesPullingTime="2.379485462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:31.349055489 +0000 UTC m=+499.111976025" watchObservedRunningTime="2026-07-30 20:29:31.349844369 +0000 UTC m=+499.112764913"
Jul 30 20:29:37.343145 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:37.343116    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7cf66f64b9-m9npl"
Jul 30 20:29:57.643526 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.643491    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"]
Jul 30 20:29:57.646953 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.646934    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.649648 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.649625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 20:29:57.649778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.649648    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 20:29:57.650732 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.650713    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-67tzk\""
Jul 30 20:29:57.650827 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.650747    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 20:29:57.656322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.656297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"]
Jul 30 20:29:57.755430 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-777n5\" (UniqueName: \"kubernetes.io/projected/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-kube-api-access-777n5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.755601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.755601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.755601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.755601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755599    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.755772 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.755641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.856815 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.856778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.856815 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.856815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-777n5\" (UniqueName: \"kubernetes.io/projected/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-kube-api-access-777n5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.856866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.856885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.856924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.857005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857317 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.857294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.857317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.857442 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.857390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.859208 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.859189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.859272 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.859221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.865154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.865133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-777n5\" (UniqueName: \"kubernetes.io/projected/9f8ec850-2e6f-4621-9e8a-2beb343ee0fa-kube-api-access-777n5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch\" (UID: \"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:57.958276 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:57.958184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:29:58.101068 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:58.101039    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"]
Jul 30 20:29:58.102818 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:29:58.102790    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8ec850_2e6f_4621_9e8a_2beb343ee0fa.slice/crio-dd80fa289a3b6e96a4942ab7eed668a04e751aa1bc0d7a6a369e68d29ce508a7 WatchSource:0}: Error finding container dd80fa289a3b6e96a4942ab7eed668a04e751aa1bc0d7a6a369e68d29ce508a7: Status 404 returned error can't find the container with id dd80fa289a3b6e96a4942ab7eed668a04e751aa1bc0d7a6a369e68d29ce508a7
Jul 30 20:29:58.471144 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:58.471091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch" event={"ID":"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa","Type":"ContainerStarted","Data":"dd80fa289a3b6e96a4942ab7eed668a04e751aa1bc0d7a6a369e68d29ce508a7"}
Jul 30 20:29:59.477657 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:59.477573    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch" event={"ID":"9f8ec850-2e6f-4621-9e8a-2beb343ee0fa","Type":"ContainerStarted","Data":"a96f37e40eb71ea5c9a9652644118002e8286b127b389005f603f8f070ce61f5"}
Jul 30 20:29:59.494798 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:29:59.494747    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch" podStartSLOduration=1.39903369 podStartE2EDuration="2.494732154s" totalImagesPullingTime="1.095698464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:29:59.49305447 +0000 UTC m=+527.255975008" watchObservedRunningTime="2026-07-30 20:29:59.494732154 +0000 UTC m=+527.257652687"
Jul 30 20:30:07.959505 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:30:07.959420    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:30:07.959505 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:30:07.959492    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:30:07.972024 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:30:07.971994    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:30:08.532267 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:30:08.532232    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch"
Jul 30 20:33:32.061808 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.061776    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78fcb895fc-gdh7k"]
Jul 30 20:33:32.065356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.065334    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.081386 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.081346    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fcb895fc-gdh7k"]
Jul 30 20:33:32.157074 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.157030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2l9z\" (UniqueName: \"kubernetes.io/projected/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-kube-api-access-l2l9z\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.157240 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.157146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-tls-cert\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.258331 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.258282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-tls-cert\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.258559 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.258392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2l9z\" (UniqueName: \"kubernetes.io/projected/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-kube-api-access-l2l9z\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.260707 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.260662    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-tls-cert\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.267466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.267442    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2l9z\" (UniqueName: \"kubernetes.io/projected/c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe-kube-api-access-l2l9z\") pod \"authorino-78fcb895fc-gdh7k\" (UID: \"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe\") " pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.374485 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.374407    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fcb895fc-gdh7k"
Jul 30 20:33:32.507468 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.507445    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fcb895fc-gdh7k"]
Jul 30 20:33:32.509585 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:33:32.509540    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8cbe78d_14fe_4f3b_beea_ce5b8b69dbfe.slice/crio-008fe75a44366747d05bf02a574acc4f5c45a7f59fdd3d14eca06330f817b17a WatchSource:0}: Error finding container 008fe75a44366747d05bf02a574acc4f5c45a7f59fdd3d14eca06330f817b17a: Status 404 returned error can't find the container with id 008fe75a44366747d05bf02a574acc4f5c45a7f59fdd3d14eca06330f817b17a
Jul 30 20:33:32.510933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.510909    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:33:32.526421 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:32.526392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fcb895fc-gdh7k" event={"ID":"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe","Type":"ContainerStarted","Data":"008fe75a44366747d05bf02a574acc4f5c45a7f59fdd3d14eca06330f817b17a"}
Jul 30 20:33:33.535047 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.535011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fcb895fc-gdh7k" event={"ID":"c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe","Type":"ContainerStarted","Data":"7fb881b56d7eb350b9ccf186291b9f22a1d155e2a867b180bab56ce912e95cbd"}
Jul 30 20:33:33.550921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.550869    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78fcb895fc-gdh7k" podStartSLOduration=0.689741292 podStartE2EDuration="1.550851732s" totalImagesPullingTime="861.11044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:33:33.550226205 +0000 UTC m=+741.313146742" watchObservedRunningTime="2026-07-30 20:33:33.550851732 +0000 UTC m=+741.313772266"
Jul 30 20:33:33.578400 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.578364    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:33:33.578590 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.578565    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" podUID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" containerName="authorino" containerID="cri-o://a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6" gracePeriod=30
Jul 30 20:33:33.837708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.833929    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:33:33.974578 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.974487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m4ds\" (UniqueName: \"kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds\") pod \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") "
Jul 30 20:33:33.974578 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.974570    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert\") pod \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\" (UID: \"fe8a54dc-2ece-409f-8db3-5fe8840b783d\") "
Jul 30 20:33:33.976720 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.976661    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds" (OuterVolumeSpecName: "kube-api-access-8m4ds") pod "fe8a54dc-2ece-409f-8db3-5fe8840b783d" (UID: "fe8a54dc-2ece-409f-8db3-5fe8840b783d"). InnerVolumeSpecName "kube-api-access-8m4ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:33:33.984855 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:33.984830    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fe8a54dc-2ece-409f-8db3-5fe8840b783d" (UID: "fe8a54dc-2ece-409f-8db3-5fe8840b783d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:33:34.075641 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.075605    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m4ds\" (UniqueName: \"kubernetes.io/projected/fe8a54dc-2ece-409f-8db3-5fe8840b783d-kube-api-access-8m4ds\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:33:34.075641 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.075635    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fe8a54dc-2ece-409f-8db3-5fe8840b783d-tls-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:33:34.540975 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.540941    2583 generic.go:356] "Generic (PLEG): container finished" podID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" containerID="a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6" exitCode=0
Jul 30 20:33:34.541469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.541003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5"
Jul 30 20:33:34.541469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.541032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" event={"ID":"fe8a54dc-2ece-409f-8db3-5fe8840b783d","Type":"ContainerDied","Data":"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"}
Jul 30 20:33:34.541469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.541086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff5b686c6-2rrt5" event={"ID":"fe8a54dc-2ece-409f-8db3-5fe8840b783d","Type":"ContainerDied","Data":"1dd369cea7faf419235854b4778040c7db9c1534c2dce8d65bf380d2fa3b1fcd"}
Jul 30 20:33:34.541469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.541109    2583 scope.go:117] "RemoveContainer" containerID="a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"
Jul 30 20:33:34.551129 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.551109    2583 scope.go:117] "RemoveContainer" containerID="a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"
Jul 30 20:33:34.551442 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:33:34.551412    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6\": container with ID starting with a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6 not found: ID does not exist" containerID="a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"
Jul 30 20:33:34.551506 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.551450    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6"} err="failed to get container status \"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6\": rpc error: code = NotFound desc = could not find container \"a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6\": container with ID starting with a56385b3cace2cbf1cae8f387795dc662a85e39490b652f98d20f04db38a9ad6 not found: ID does not exist"
Jul 30 20:33:34.564274 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.564241    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:33:34.568502 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.568473    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ff5b686c6-2rrt5"]
Jul 30 20:33:34.754781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:33:34.754752    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" path="/var/lib/kubelet/pods/fe8a54dc-2ece-409f-8db3-5fe8840b783d/volumes"
Jul 30 20:45:00.146698 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.146649    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"]
Jul 30 20:45:00.147172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.147069    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" containerName="authorino"
Jul 30 20:45:00.147172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.147080    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" containerName="authorino"
Jul 30 20:45:00.147172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.147142    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8a54dc-2ece-409f-8db3-5fe8840b783d" containerName="authorino"
Jul 30 20:45:00.150290 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.150271    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"
Jul 30 20:45:00.153299 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.153276    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-58j97\""
Jul 30 20:45:00.159753 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.159733    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"
Jul 30 20:45:00.167435 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.167405    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"]
Jul 30 20:45:00.299968 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.299943    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"]
Jul 30 20:45:00.302184 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:45:00.302147    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2ddf181_a0b4_49e6_bb8c_ddf0cd230bc0.slice/crio-39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da WatchSource:0}: Error finding container 39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da: Status 404 returned error can't find the container with id 39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da
Jul 30 20:45:00.303867 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.303850    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:45:00.926678 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:00.926642    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n" event={"ID":"f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0","Type":"ContainerStarted","Data":"39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da"}
Jul 30 20:45:03.945492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:03.945455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n" event={"ID":"f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0","Type":"ContainerStarted","Data":"f178c80c99fb519c55f818e50baf287b834e5ec8080955983cbcb442be0c0de6"}
Jul 30 20:45:03.961582 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:03.961524    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n" podStartSLOduration=1.143581376 podStartE2EDuration="3.961505219s" totalImagesPullingTime="2.817923843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:45:03.959986382 +0000 UTC m=+1431.722906917" watchObservedRunningTime="2026-07-30 20:45:03.961505219 +0000 UTC m=+1431.724425753"
Jul 30 20:45:04.951854 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:04.951770    2583 generic.go:356] "Generic (PLEG): container finished" podID="f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0" containerID="f178c80c99fb519c55f818e50baf287b834e5ec8080955983cbcb442be0c0de6" exitCode=0
Jul 30 20:45:04.952237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:04.951859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n" event={"ID":"f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0","Type":"ContainerDied","Data":"f178c80c99fb519c55f818e50baf287b834e5ec8080955983cbcb442be0c0de6"}
Jul 30 20:45:06.095433 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:06.095402    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"
Jul 30 20:45:06.962987 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:06.962954    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n"
Jul 30 20:45:06.962987 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:06.962972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757405-fpc9n" event={"ID":"f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0","Type":"ContainerDied","Data":"39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da"}
Jul 30 20:45:06.963240 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:45:06.963039    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39591bb5f8e36af862ad73a634b315e26bd9fcda9d70d7f9a472a426d183f4da"
Jul 30 20:46:07.365795 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.365749    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:46:07.366405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.366187    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0" containerName="cleanup"
Jul 30 20:46:07.366405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.366199    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0" containerName="cleanup"
Jul 30 20:46:07.366405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.366280    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0" containerName="cleanup"
Jul 30 20:46:07.369582 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.369560    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.372356 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.372327    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-da444a73-kserve-self-signed-certs\""
Jul 30 20:46:07.377632 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.377610    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:46:07.496564 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.496771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.496771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.496771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh6jl\" (UniqueName: \"kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.496771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.496771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.496712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597509 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597509 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh6jl\" (UniqueName: \"kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.597781 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.598018 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.597995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.598082 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.598028    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.598127 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.598079    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.599853 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.599819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.600034 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.600019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.606829 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.606805    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh6jl\" (UniqueName: \"kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl\") pod \"e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") " pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.680809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.680723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:07.822891 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:07.822857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:46:07.826672 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:46:07.826645    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48cb45c4_9822_4fa6_9b38_44323fec6031.slice/crio-c595f05c39c41f63839a0ad4745eec53f6a410759bcd2610eceaca08fca737f6 WatchSource:0}: Error finding container c595f05c39c41f63839a0ad4745eec53f6a410759bcd2610eceaca08fca737f6: Status 404 returned error can't find the container with id c595f05c39c41f63839a0ad4745eec53f6a410759bcd2610eceaca08fca737f6
Jul 30 20:46:08.287374 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:08.287342    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" event={"ID":"48cb45c4-9822-4fa6-9b38-44323fec6031","Type":"ContainerStarted","Data":"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"}
Jul 30 20:46:08.287374 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:08.287381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" event={"ID":"48cb45c4-9822-4fa6-9b38-44323fec6031","Type":"ContainerStarted","Data":"c595f05c39c41f63839a0ad4745eec53f6a410759bcd2610eceaca08fca737f6"}
Jul 30 20:46:08.304976 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:08.304924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" podStartSLOduration=1.304908673 podStartE2EDuration="1.304908673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:46:08.303517662 +0000 UTC m=+1496.066438191" watchObservedRunningTime="2026-07-30 20:46:08.304908673 +0000 UTC m=+1496.067829253"
Jul 30 20:46:17.681471 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.681371    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:17.681471 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.681434    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:17.694081 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.694049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:17.954777 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.954680    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:46:17.958259 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.958237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:17.960806 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.960782    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-da444a73-kserve-self-signed-certs\""
Jul 30 20:46:17.968198 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:17.968173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:46:18.095644 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095584    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.095813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.095813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2vjk\" (UniqueName: \"kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.095813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.095813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.095969 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.095847    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2vjk\" (UniqueName: \"kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.196897 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.196826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.197160 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.197111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.197160 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.197122    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.197243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.197215    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.199137 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.199104    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.199510 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.199487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.204776 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.204750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2vjk\" (UniqueName: \"kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk\") pod \"e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") " pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.269500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.269455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:18.352109 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.352067    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:46:18.416627 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:18.416601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:46:18.420035 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:46:18.419997    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc114bbd_a2c3_4af7_b795_78661a27111b.slice/crio-3361c044ff72d9c0c9eefec3d9e55adb230e11df6bc0eea3bedcfb02fef866bd WatchSource:0}: Error finding container 3361c044ff72d9c0c9eefec3d9e55adb230e11df6bc0eea3bedcfb02fef866bd: Status 404 returned error can't find the container with id 3361c044ff72d9c0c9eefec3d9e55adb230e11df6bc0eea3bedcfb02fef866bd
Jul 30 20:46:19.347216 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:19.347184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" event={"ID":"bc114bbd-a2c3-4af7-b795-78661a27111b","Type":"ContainerStarted","Data":"c39419a21762e7fb93af68354be00b7c22fdfddbd6127111b2da3a1f05478953"}
Jul 30 20:46:19.347754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:19.347228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" event={"ID":"bc114bbd-a2c3-4af7-b795-78661a27111b","Type":"ContainerStarted","Data":"3361c044ff72d9c0c9eefec3d9e55adb230e11df6bc0eea3bedcfb02fef866bd"}
Jul 30 20:46:19.365942 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:19.365891    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" podStartSLOduration=2.365874774 podStartE2EDuration="2.365874774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:46:19.363865866 +0000 UTC m=+1507.126786398" watchObservedRunningTime="2026-07-30 20:46:19.365874774 +0000 UTC m=+1507.128795345"
Jul 30 20:46:28.270415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:28.270369    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:28.270415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:28.270431    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:28.283107 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:28.283080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:28.404982 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:28.404953    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:46:47.700062 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:47.699974    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:46:49.385132 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:46:49.385094    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:47:02.719779 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:02.719734    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" podUID="48cb45c4-9822-4fa6-9b38-44323fec6031" containerName="main" containerID="cri-o://9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c" gracePeriod=45
Jul 30 20:47:02.979415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:02.979385    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:47:03.133395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh6jl\" (UniqueName: \"kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133452    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133542    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133836 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home\") pod \"48cb45c4-9822-4fa6-9b38-44323fec6031\" (UID: \"48cb45c4-9822-4fa6-9b38-44323fec6031\") "
Jul 30 20:47:03.133890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133825    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache" (OuterVolumeSpecName: "model-cache") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:03.133890 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.133861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:03.134025 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.134000    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home" (OuterVolumeSpecName: "home") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:03.134133 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.134111    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-tmp-dir\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.134190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.134137    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-model-cache\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.134190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.134151    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-home\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.135878 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.135855    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm" (OuterVolumeSpecName: "dshm") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:03.135878 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.135861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:47:03.135995 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.135886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl" (OuterVolumeSpecName: "kube-api-access-wh6jl") pod "48cb45c4-9822-4fa6-9b38-44323fec6031" (UID: "48cb45c4-9822-4fa6-9b38-44323fec6031"). InnerVolumeSpecName "kube-api-access-wh6jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:47:03.235670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.235578    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh6jl\" (UniqueName: \"kubernetes.io/projected/48cb45c4-9822-4fa6-9b38-44323fec6031-kube-api-access-wh6jl\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.235670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.235613    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48cb45c4-9822-4fa6-9b38-44323fec6031-tls-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.235670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.235623    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48cb45c4-9822-4fa6-9b38-44323fec6031-dshm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:03.575896 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.575807    2583 generic.go:356] "Generic (PLEG): container finished" podID="48cb45c4-9822-4fa6-9b38-44323fec6031" containerID="9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c" exitCode=0
Jul 30 20:47:03.575896 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.575853    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"
Jul 30 20:47:03.576076 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.575894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" event={"ID":"48cb45c4-9822-4fa6-9b38-44323fec6031","Type":"ContainerDied","Data":"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"}
Jul 30 20:47:03.576076 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.575946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4" event={"ID":"48cb45c4-9822-4fa6-9b38-44323fec6031","Type":"ContainerDied","Data":"c595f05c39c41f63839a0ad4745eec53f6a410759bcd2610eceaca08fca737f6"}
Jul 30 20:47:03.576076 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.575968    2583 scope.go:117] "RemoveContainer" containerID="9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"
Jul 30 20:47:03.585311 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.585291    2583 scope.go:117] "RemoveContainer" containerID="9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"
Jul 30 20:47:03.585605 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:47:03.585582    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c\": container with ID starting with 9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c not found: ID does not exist" containerID="9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"
Jul 30 20:47:03.585642 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.585619    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c"} err="failed to get container status \"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c\": rpc error: code = NotFound desc = could not find container \"9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c\": container with ID starting with 9417e33032f721e14b5a2f37135df1783e2e014df3b1e23a6ea79ee42bb89d4c not found: ID does not exist"
Jul 30 20:47:03.598975 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.598942    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:47:03.602234 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:03.602208    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-da444a73-kserve-5dd59599-zcdp4"]
Jul 30 20:47:04.404326 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.404283    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" podUID="bc114bbd-a2c3-4af7-b795-78661a27111b" containerName="main" containerID="cri-o://c39419a21762e7fb93af68354be00b7c22fdfddbd6127111b2da3a1f05478953" gracePeriod=45
Jul 30 20:47:04.587097 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.587064    2583 generic.go:356] "Generic (PLEG): container finished" podID="bc114bbd-a2c3-4af7-b795-78661a27111b" containerID="c39419a21762e7fb93af68354be00b7c22fdfddbd6127111b2da3a1f05478953" exitCode=0
Jul 30 20:47:04.587261 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.587138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" event={"ID":"bc114bbd-a2c3-4af7-b795-78661a27111b","Type":"ContainerDied","Data":"c39419a21762e7fb93af68354be00b7c22fdfddbd6127111b2da3a1f05478953"}
Jul 30 20:47:04.657126 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.657056    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:47:04.750962 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.750932    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.750986    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751131    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751270 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2vjk\" (UniqueName: \"kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751333 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751301    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751333 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751328    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir\") pod \"bc114bbd-a2c3-4af7-b795-78661a27111b\" (UID: \"bc114bbd-a2c3-4af7-b795-78661a27111b\") "
Jul 30 20:47:04.751469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751423    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home" (OuterVolumeSpecName: "home") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:04.751641 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751589    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache" (OuterVolumeSpecName: "model-cache") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:04.751801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751647    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:04.751801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751762    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-model-cache\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:04.751801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751785    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-tmp-dir\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:04.751801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.751800    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-home\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:04.753487 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.753462    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm" (OuterVolumeSpecName: "dshm") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:47:04.753487 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.753466    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk" (OuterVolumeSpecName: "kube-api-access-n2vjk") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "kube-api-access-n2vjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:47:04.753662 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.753577    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bc114bbd-a2c3-4af7-b795-78661a27111b" (UID: "bc114bbd-a2c3-4af7-b795-78661a27111b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:47:04.754453 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.754428    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48cb45c4-9822-4fa6-9b38-44323fec6031" path="/var/lib/kubelet/pods/48cb45c4-9822-4fa6-9b38-44323fec6031/volumes"
Jul 30 20:47:04.852778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.852744    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2vjk\" (UniqueName: \"kubernetes.io/projected/bc114bbd-a2c3-4af7-b795-78661a27111b-kube-api-access-n2vjk\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:04.852778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.852772    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc114bbd-a2c3-4af7-b795-78661a27111b-tls-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:04.852778 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:04.852784    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc114bbd-a2c3-4af7-b795-78661a27111b-dshm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:47:05.593304 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:05.593273    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"
Jul 30 20:47:05.593304 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:05.593294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj" event={"ID":"bc114bbd-a2c3-4af7-b795-78661a27111b","Type":"ContainerDied","Data":"3361c044ff72d9c0c9eefec3d9e55adb230e11df6bc0eea3bedcfb02fef866bd"}
Jul 30 20:47:05.593796 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:05.593338    2583 scope.go:117] "RemoveContainer" containerID="c39419a21762e7fb93af68354be00b7c22fdfddbd6127111b2da3a1f05478953"
Jul 30 20:47:05.609492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:05.609460    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:47:05.613424 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:05.613397    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-da444a73-kserve-cb77f7699-5ttrj"]
Jul 30 20:47:06.754023 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:47:06.753990    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc114bbd-a2c3-4af7-b795-78661a27111b" path="/var/lib/kubelet/pods/bc114bbd-a2c3-4af7-b795-78661a27111b/volumes"
Jul 30 20:50:43.882549 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.882515    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.882917    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc114bbd-a2c3-4af7-b795-78661a27111b" containerName="main"
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.882929    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc114bbd-a2c3-4af7-b795-78661a27111b" containerName="main"
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.882951    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48cb45c4-9822-4fa6-9b38-44323fec6031" containerName="main"
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.882957    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="48cb45c4-9822-4fa6-9b38-44323fec6031" containerName="main"
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.883027    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="48cb45c4-9822-4fa6-9b38-44323fec6031" containerName="main"
Jul 30 20:50:43.885053 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.883037    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc114bbd-a2c3-4af7-b795-78661a27111b" containerName="main"
Jul 30 20:50:43.886155 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.886139    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.888828 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.888806    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 20:50:43.889037 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.889020    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ae95a8d6-openshift-default-dockercfg-dwm4b\""
Jul 30 20:50:43.949169 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.949125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:50:43.982287 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982292    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn6bn\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:43.982845 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:43.982558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083185 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083185 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn6bn\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083431 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.083586 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.083557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.084392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.084268    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.084392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.084335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.084570 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.084532    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.084713 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.084643    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.092460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.086469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.092460 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.086797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.093489 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.093462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn6bn\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.094861 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.094839    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token\") pod \"e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") " pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.196164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.196075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:44.341883 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.341858    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:50:44.344147 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:50:44.344123    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfe541e_963f_4931_b35d_a021a094aa73.slice/crio-ac72fb2d6353911f7a8e396d9072c0558f40905281f2b78bf4036af3c1e0408c WatchSource:0}: Error finding container ac72fb2d6353911f7a8e396d9072c0558f40905281f2b78bf4036af3c1e0408c: Status 404 returned error can't find the container with id ac72fb2d6353911f7a8e396d9072c0558f40905281f2b78bf4036af3c1e0408c
Jul 30 20:50:44.346058 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.346040    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:50:44.679313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:44.679279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerStarted","Data":"ac72fb2d6353911f7a8e396d9072c0558f40905281f2b78bf4036af3c1e0408c"}
Jul 30 20:50:46.639840 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:46.639802    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:50:46.640121 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:46.639876    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:50:46.640121 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:46.639908    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:50:47.696846 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:47.696813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerStarted","Data":"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"}
Jul 30 20:50:47.717491 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:47.717440    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podStartSLOduration=2.424141124 podStartE2EDuration="4.71742096s" totalImagesPullingTime="2.293279836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:50:47.716600849 +0000 UTC m=+1775.479521385" watchObservedRunningTime="2026-07-30 20:50:47.71742096 +0000 UTC m=+1775.480341493"
Jul 30 20:50:48.196229 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:48.196200    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:48.201552 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:48.201523    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:48.702083 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:48.702049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:48.703218 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:48.703200    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:50:50.261447 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.261410    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:50:50.265172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.265148    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.268553 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.268529    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ae95a8d6-serving-cert\""
Jul 30 20:50:50.277893 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.277864    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:50:50.348021 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.347991    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjj6w\" (UniqueName: \"kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.348198 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.348091    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.348198 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.348192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.449306 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.449267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjj6w\" (UniqueName: \"kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.449490 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.449315    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.449490 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.449365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.450079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.450061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.451776 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.451750    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.458921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.458892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjj6w\" (UniqueName: \"kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w\") pod \"maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.575445 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.575351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:50.717752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:50.717714    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:50:50.720173 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:50:50.720142    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb3fd42_8033_47bf_926e_fd581d4ebe21.slice/crio-e7804e5c0437e465cdc37d78cfe8ef969ff66ed7298f146bc571d6ecd1729c41 WatchSource:0}: Error finding container e7804e5c0437e465cdc37d78cfe8ef969ff66ed7298f146bc571d6ecd1729c41: Status 404 returned error can't find the container with id e7804e5c0437e465cdc37d78cfe8ef969ff66ed7298f146bc571d6ecd1729c41
Jul 30 20:50:51.718288 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:51.718202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" event={"ID":"5eb3fd42-8033-47bf-926e-fd581d4ebe21","Type":"ContainerStarted","Data":"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"}
Jul 30 20:50:51.718288 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:51.718254    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" event={"ID":"5eb3fd42-8033-47bf-926e-fd581d4ebe21","Type":"ContainerStarted","Data":"e7804e5c0437e465cdc37d78cfe8ef969ff66ed7298f146bc571d6ecd1729c41"}
Jul 30 20:50:51.718707 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:51.718306    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:50:51.736961 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:51.736907    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" podStartSLOduration=1.163918901 podStartE2EDuration="1.736889596s" totalImagesPullingTime="572.970695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:50:51.735320718 +0000 UTC m=+1779.498241253" watchObservedRunningTime="2026-07-30 20:50:51.736889596 +0000 UTC m=+1779.499810129"
Jul 30 20:50:57.741056 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:50:57.741012    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:51:02.782158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.782124    2583 generic.go:356] "Generic (PLEG): container finished" podID="bcfe541e-963f-4931-b35d-a021a094aa73" containerID="cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d" exitCode=0
Jul 30 20:51:02.782614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.782185    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerDied","Data":"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"}
Jul 30 20:51:02.782614 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.782598    2583 scope.go:117] "RemoveContainer" containerID="cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"
Jul 30 20:51:02.784626 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.784582    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:02.784753 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.784668    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:02.784753 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:02.784726    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:03.702883 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:03.702831    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:03.789468 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:03.789434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerStarted","Data":"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"}
Jul 30 20:51:04.197270 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:04.197231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:04.198466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:04.198436    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 20:51:04.198603 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:04.198485    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 20:51:05.196904 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:05.196870    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 20:51:05.197404 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:05.196951    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 20:51:06.196698 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:06.196657    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 20:51:06.196883 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:06.196750    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 20:51:07.197274 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:07.197236    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 20:51:07.197661 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:07.197292    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 20:51:08.197059 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:08.197021    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 30 20:51:08.197254 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:08.197079    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 30 20:51:09.212613 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:09.212580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:09.213067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:09.213044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:09.213934 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:09.213904    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:20.791096 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:20.791002    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:51:20.791961 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:20.791882    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" podUID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" containerName="maas-api" containerID="cri-o://2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1" gracePeriod=30
Jul 30 20:51:21.041792 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.041731    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:51:21.164542 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.164504    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:51:21.165051 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.165018    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" containerID="cri-o://35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b" gracePeriod=30
Jul 30 20:51:21.171979 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.171947    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls\") pod \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") "
Jul 30 20:51:21.172144 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.172012    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjj6w\" (UniqueName: \"kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w\") pod \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") "
Jul 30 20:51:21.172144 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.172045    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca\") pod \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\" (UID: \"5eb3fd42-8033-47bf-926e-fd581d4ebe21\") "
Jul 30 20:51:21.172818 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.172786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5eb3fd42-8033-47bf-926e-fd581d4ebe21" (UID: "5eb3fd42-8033-47bf-926e-fd581d4ebe21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:51:21.175039 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.174997    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5eb3fd42-8033-47bf-926e-fd581d4ebe21" (UID: "5eb3fd42-8033-47bf-926e-fd581d4ebe21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:51:21.175039 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.175008    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w" (OuterVolumeSpecName: "kube-api-access-qjj6w") pod "5eb3fd42-8033-47bf-926e-fd581d4ebe21" (UID: "5eb3fd42-8033-47bf-926e-fd581d4ebe21"). InnerVolumeSpecName "kube-api-access-qjj6w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:51:21.273140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.273105    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eb3fd42-8033-47bf-926e-fd581d4ebe21-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:21.273140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.273135    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjj6w\" (UniqueName: \"kubernetes.io/projected/5eb3fd42-8033-47bf-926e-fd581d4ebe21-kube-api-access-qjj6w\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:21.273140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.273145    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb3fd42-8033-47bf-926e-fd581d4ebe21-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:21.880080 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.880039    2583 generic.go:356] "Generic (PLEG): container finished" podID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" containerID="2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1" exitCode=0
Jul 30 20:51:21.880571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.880092    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"
Jul 30 20:51:21.880571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.880114    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" event={"ID":"5eb3fd42-8033-47bf-926e-fd581d4ebe21","Type":"ContainerDied","Data":"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"}
Jul 30 20:51:21.880571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.880163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq" event={"ID":"5eb3fd42-8033-47bf-926e-fd581d4ebe21","Type":"ContainerDied","Data":"e7804e5c0437e465cdc37d78cfe8ef969ff66ed7298f146bc571d6ecd1729c41"}
Jul 30 20:51:21.880571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.880190    2583 scope.go:117] "RemoveContainer" containerID="2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"
Jul 30 20:51:21.890008 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.889989    2583 scope.go:117] "RemoveContainer" containerID="2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"
Jul 30 20:51:21.890300 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:21.890280    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1\": container with ID starting with 2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1 not found: ID does not exist" containerID="2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"
Jul 30 20:51:21.890381 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.890310    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1"} err="failed to get container status \"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1\": rpc error: code = NotFound desc = could not find container \"2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1\": container with ID starting with 2cd508bc06b7ddebffe952358c06b0a9be12dd6d343d819ea84fc905fcfceee1 not found: ID does not exist"
Jul 30 20:51:21.902949 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.902917    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:51:21.906838 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:21.906815    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ae95a8d6-b9549dd5-svzbq"]
Jul 30 20:51:22.266180 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.266144    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:51:22.266589 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.266575    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" containerName="maas-api"
Jul 30 20:51:22.266632 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.266593    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" containerName="maas-api"
Jul 30 20:51:22.266667 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.266654    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" containerName="maas-api"
Jul 30 20:51:22.271309 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.271289    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.274295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.274273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1f4c9be7-gw-openshift-default-dockercfg-tlwxz\""
Jul 30 20:51:22.286128 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.286106    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:51:22.382904 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.382867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.382925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.382945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.382997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.383032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.383051    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383090 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.383083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383326 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.383212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59r8p\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.383326 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.383262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.483822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.483787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.483822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.483823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.483845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.483868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.483979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484101 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59r8p\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484438 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484110    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484438 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484438 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484600 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484728 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484799 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.484799 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.484753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.486430 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.486414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.486569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.486552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.493818 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.493791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.493926 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.493852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59r8p\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p\") pod \"e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") " pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.581305 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.581224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:22.723565 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.723540    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:51:22.725603 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:51:22.725578    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c39f0c_80c2_4858_9d05_dcd4da02fa56.slice/crio-bd6f499b9eb3f77a229750f25fa4f2d9097c16b8436f0d0082ca9988198fb610 WatchSource:0}: Error finding container bd6f499b9eb3f77a229750f25fa4f2d9097c16b8436f0d0082ca9988198fb610: Status 404 returned error can't find the container with id bd6f499b9eb3f77a229750f25fa4f2d9097c16b8436f0d0082ca9988198fb610
Jul 30 20:51:22.728058 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.728027    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:22.728159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.728098    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:22.728159 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.728127    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:22.757205 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.757144    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb3fd42-8033-47bf-926e-fd581d4ebe21" path="/var/lib/kubelet/pods/5eb3fd42-8033-47bf-926e-fd581d4ebe21/volumes"
Jul 30 20:51:22.890830 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.890731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerStarted","Data":"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"}
Jul 30 20:51:22.891415 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.891379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerStarted","Data":"bd6f499b9eb3f77a229750f25fa4f2d9097c16b8436f0d0082ca9988198fb610"}
Jul 30 20:51:22.933217 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:22.933151    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podStartSLOduration=0.933131183 podStartE2EDuration="933.131183ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:51:22.928866438 +0000 UTC m=+1810.691786972" watchObservedRunningTime="2026-07-30 20:51:22.933131183 +0000 UTC m=+1810.696051718"
Jul 30 20:51:23.581900 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:23.581858    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:23.587129 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:23.587100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:23.898086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:23.897996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:23.899120 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:23.899102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:24.215118 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.215032    2583 patch_prober.go:28] interesting pod/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:51:24.215118 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.215101    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:51:24.624202 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.624163    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:24.629598 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.629568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.633034 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.633006    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-1f4c9be7-serving-cert\""
Jul 30 20:51:24.637452 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.637292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:24.704607 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.704571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.704842 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.704730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzh6j\" (UniqueName: \"kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.704842 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.704768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.806136 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.806103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.806357 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.806200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzh6j\" (UniqueName: \"kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.806357 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.806220    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.806499 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:24.806359    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-serving-cert: secret "maas-api-e2e-migrate-1f4c9be7-serving-cert" not found
Jul 30 20:51:24.806499 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:24.806460    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls podName:a53607fa-9851-4965-95f1-e9fc4823728b nodeName:}" failed. No retries permitted until 2026-07-30 20:51:25.306438114 +0000 UTC m=+1813.069358625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls") pod "maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" (UID: "a53607fa-9851-4965-95f1-e9fc4823728b") : secret "maas-api-e2e-migrate-1f4c9be7-serving-cert" not found
Jul 30 20:51:24.806863 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.806840    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:24.816039 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:24.816003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzh6j\" (UniqueName: \"kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:25.312324 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:25.312284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:25.312759 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:25.312440    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-serving-cert: secret "maas-api-e2e-migrate-1f4c9be7-serving-cert" not found
Jul 30 20:51:25.312759 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:25.312504    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls podName:a53607fa-9851-4965-95f1-e9fc4823728b nodeName:}" failed. No retries permitted until 2026-07-30 20:51:26.312488677 +0000 UTC m=+1814.075409193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls") pod "maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" (UID: "a53607fa-9851-4965-95f1-e9fc4823728b") : secret "maas-api-e2e-migrate-1f4c9be7-serving-cert" not found
Jul 30 20:51:26.324312 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.324274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:26.326672 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.326642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:26.419752 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.419673    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:26.442841 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.442809    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:26.526366 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526334    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526534 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn6bn\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526534 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526534 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526515    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526734 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526734 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526590    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526734 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526734 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526674    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526740    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy\") pod \"bcfe541e-963f-4931-b35d-a021a094aa73\" (UID: \"bcfe541e-963f-4931-b35d-a021a094aa73\") "
Jul 30 20:51:26.526929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526859    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:51:26.526929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.526895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:51:26.527145 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.527107    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:51:26.527217 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.527193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:51:26.527285 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.527262    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.527346 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.527283    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.527346 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.527314    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:51:26.528858 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.528833    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn" (OuterVolumeSpecName: "kube-api-access-gn6bn") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "kube-api-access-gn6bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:51:26.528964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.528882    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:51:26.528964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.528934    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:51:26.529438 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.529416    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcfe541e-963f-4931-b35d-a021a094aa73" (UID: "bcfe541e-963f-4931-b35d-a021a094aa73"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:51:26.590553 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.590525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:26.593170 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:51:26.593145    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53607fa_9851_4965_95f1_e9fc4823728b.slice/crio-e466847a1410ac613d842249387d8827db7c91917544e60bb9371d1620b19c40 WatchSource:0}: Error finding container e466847a1410ac613d842249387d8827db7c91917544e60bb9371d1620b19c40: Status 404 returned error can't find the container with id e466847a1410ac613d842249387d8827db7c91917544e60bb9371d1620b19c40
Jul 30 20:51:26.628394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628357    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628385    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcfe541e-963f-4931-b35d-a021a094aa73-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628394 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628398    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcfe541e-963f-4931-b35d-a021a094aa73-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628406    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628418    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628427    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn6bn\" (UniqueName: \"kubernetes.io/projected/bcfe541e-963f-4931-b35d-a021a094aa73-kube-api-access-gn6bn\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.628636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.628435    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcfe541e-963f-4931-b35d-a021a094aa73-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:26.914648 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.914613    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" event={"ID":"a53607fa-9851-4965-95f1-e9fc4823728b","Type":"ContainerStarted","Data":"e466847a1410ac613d842249387d8827db7c91917544e60bb9371d1620b19c40"}
Jul 30 20:51:26.916321 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.916296    2583 generic.go:356] "Generic (PLEG): container finished" podID="bcfe541e-963f-4931-b35d-a021a094aa73" containerID="35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b" exitCode=0
Jul 30 20:51:26.916442 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.916345    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"
Jul 30 20:51:26.916442 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.916377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerDied","Data":"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"}
Jul 30 20:51:26.916442 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.916427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c" event={"ID":"bcfe541e-963f-4931-b35d-a021a094aa73","Type":"ContainerDied","Data":"ac72fb2d6353911f7a8e396d9072c0558f40905281f2b78bf4036af3c1e0408c"}
Jul 30 20:51:26.916549 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.916456    2583 scope.go:117] "RemoveContainer" containerID="35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"
Jul 30 20:51:26.925152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.925130    2583 scope.go:117] "RemoveContainer" containerID="cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"
Jul 30 20:51:26.933477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.933452    2583 scope.go:117] "RemoveContainer" containerID="35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"
Jul 30 20:51:26.933792 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:26.933755    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b\": container with ID starting with 35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b not found: ID does not exist" containerID="35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"
Jul 30 20:51:26.933867 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.933800    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b"} err="failed to get container status \"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b\": rpc error: code = NotFound desc = could not find container \"35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b\": container with ID starting with 35d28e49ea0f5920b0237b7170fea17a6304e9be7d45b08d64f96decb29e815b not found: ID does not exist"
Jul 30 20:51:26.933867 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.933817    2583 scope.go:117] "RemoveContainer" containerID="cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"
Jul 30 20:51:26.934034 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:26.934019    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d\": container with ID starting with cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d not found: ID does not exist" containerID="cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"
Jul 30 20:51:26.934074 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.934037    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d"} err="failed to get container status \"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d\": rpc error: code = NotFound desc = could not find container \"cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d\": container with ID starting with cd6f402c0a59f966e8a349adc0e00103939630132c96295f7588b907eb8e366d not found: ID does not exist"
Jul 30 20:51:26.953601 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.953573    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:51:26.958011 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:26.957987    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ae95a8d6-openshift-default-5f6b5b96b6-9ql6c"]
Jul 30 20:51:27.923127 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:27.923084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" event={"ID":"a53607fa-9851-4965-95f1-e9fc4823728b","Type":"ContainerStarted","Data":"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"}
Jul 30 20:51:27.923558 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:27.923254    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:27.950475 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:27.950417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" podStartSLOduration=3.4689235370000002 podStartE2EDuration="3.950397271s" totalImagesPullingTime="481.473734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:51:27.947803169 +0000 UTC m=+1815.710723700" watchObservedRunningTime="2026-07-30 20:51:27.950397271 +0000 UTC m=+1815.713317804"
Jul 30 20:51:28.754443 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:28.754395    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" path="/var/lib/kubelet/pods/bcfe541e-963f-4931-b35d-a021a094aa73/volumes"
Jul 30 20:51:33.938726 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:33.938699    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:37.991405 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.991371    2583 generic.go:356] "Generic (PLEG): container finished" podID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerID="e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c" exitCode=0
Jul 30 20:51:37.991879 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.991447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerDied","Data":"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"}
Jul 30 20:51:37.991935 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.991895    2583 scope.go:117] "RemoveContainer" containerID="e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"
Jul 30 20:51:37.992993 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.992966    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:37.993110 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.993066    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:37.993174 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:37.993112    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:38.898054 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:38.898013    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:38.999281 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:38.999244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerStarted","Data":"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"}
Jul 30 20:51:39.581570 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:39.581526    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:39.582516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:39.582494    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 20:51:39.582575 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:39.582546    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 20:51:40.582128 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:40.582087    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 20:51:40.582525 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:40.582160    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 20:51:41.581881 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:41.581844    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 20:51:41.582055 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:41.581916    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 20:51:42.582038 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:42.582004    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 20:51:42.582433 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:42.582071    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 20:51:43.582070 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:43.582032    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 30 20:51:43.582475 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:43.582098    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 30 20:51:44.585420 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:44.585387    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:44.585914 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:44.585898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:44.586653 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:44.586630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:51:56.126210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.126177    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:56.126736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.126374    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" podUID="a53607fa-9851-4965-95f1-e9fc4823728b" containerName="maas-api" containerID="cri-o://2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8" gracePeriod=30
Jul 30 20:51:56.380863 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.380803    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:56.532991 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.532954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzh6j\" (UniqueName: \"kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j\") pod \"a53607fa-9851-4965-95f1-e9fc4823728b\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") "
Jul 30 20:51:56.533180 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.533042    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") pod \"a53607fa-9851-4965-95f1-e9fc4823728b\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") "
Jul 30 20:51:56.533269 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.533199    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca\") pod \"a53607fa-9851-4965-95f1-e9fc4823728b\" (UID: \"a53607fa-9851-4965-95f1-e9fc4823728b\") "
Jul 30 20:51:56.533563 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.533532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a53607fa-9851-4965-95f1-e9fc4823728b" (UID: "a53607fa-9851-4965-95f1-e9fc4823728b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:51:56.536162 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.536126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a53607fa-9851-4965-95f1-e9fc4823728b" (UID: "a53607fa-9851-4965-95f1-e9fc4823728b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:51:56.536162 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.536141    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j" (OuterVolumeSpecName: "kube-api-access-pzh6j") pod "a53607fa-9851-4965-95f1-e9fc4823728b" (UID: "a53607fa-9851-4965-95f1-e9fc4823728b"). InnerVolumeSpecName "kube-api-access-pzh6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:51:56.635091 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.634993    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzh6j\" (UniqueName: \"kubernetes.io/projected/a53607fa-9851-4965-95f1-e9fc4823728b-kube-api-access-pzh6j\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:56.635091 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.635035    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a53607fa-9851-4965-95f1-e9fc4823728b-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:56.635091 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.635045    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a53607fa-9851-4965-95f1-e9fc4823728b-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:51:56.649366 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.649333    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:51:56.649599 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:56.649571    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" containerID="cri-o://c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f" gracePeriod=30
Jul 30 20:51:57.096241 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.096200    2583 generic.go:356] "Generic (PLEG): container finished" podID="a53607fa-9851-4965-95f1-e9fc4823728b" containerID="2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8" exitCode=0
Jul 30 20:51:57.096434 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.096248    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"
Jul 30 20:51:57.096434 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.096287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" event={"ID":"a53607fa-9851-4965-95f1-e9fc4823728b","Type":"ContainerDied","Data":"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"}
Jul 30 20:51:57.096434 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.096345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw" event={"ID":"a53607fa-9851-4965-95f1-e9fc4823728b","Type":"ContainerDied","Data":"e466847a1410ac613d842249387d8827db7c91917544e60bb9371d1620b19c40"}
Jul 30 20:51:57.096434 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.096368    2583 scope.go:117] "RemoveContainer" containerID="2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"
Jul 30 20:51:57.105067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.105046    2583 scope.go:117] "RemoveContainer" containerID="2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"
Jul 30 20:51:57.105356 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:51:57.105336    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8\": container with ID starting with 2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8 not found: ID does not exist" containerID="2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"
Jul 30 20:51:57.105428 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.105365    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8"} err="failed to get container status \"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8\": rpc error: code = NotFound desc = could not find container \"2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8\": container with ID starting with 2b87ddf05d36c182463b04e9d07e284c7fdad60015aa21f0f8eae2f3112f4ce8 not found: ID does not exist"
Jul 30 20:51:57.143965 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.143935    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:57.149839 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.149806    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1f4c9be7-f86c8575b-fpkcw"]
Jul 30 20:51:57.448591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.448504    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:51:57.449079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449059    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53607fa-9851-4965-95f1-e9fc4823728b" containerName="maas-api"
Jul 30 20:51:57.449251 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449082    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53607fa-9851-4965-95f1-e9fc4823728b" containerName="maas-api"
Jul 30 20:51:57.449251 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449101    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:51:57.449251 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449109    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:51:57.449251 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449246    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:51:57.449455 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449261    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:51:57.449455 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.449274    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53607fa-9851-4965-95f1-e9fc4823728b" containerName="maas-api"
Jul 30 20:51:57.453947 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.453923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.457175 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.457155    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bfe7e24b-openshift-default-dockercfg-td5vg\""
Jul 30 20:51:57.467478 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.467450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:51:57.544063 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.543977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544063 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm447\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544155    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544253    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544340 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544293    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.544635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.544362    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.644886 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.644841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.644886 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.644892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.644927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm447\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.644944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.644969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645152 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645470 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645531 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645588 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645634 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645589    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645634 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.645992 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.645968    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.647287 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.647271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.647508 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.647493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.655313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.655292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.655737 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.655714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm447\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447\") pod \"e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") " pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.764146 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.764110    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:57.933307 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.933272    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:51:57.936449 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:51:57.936406    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51f5592_047a_4d74_976b_6f426a3706cc.slice/crio-2bf6bf21e0adbdaea874a57184f406b548c1a7314ffdec09a76b27bd7e0db491 WatchSource:0}: Error finding container 2bf6bf21e0adbdaea874a57184f406b548c1a7314ffdec09a76b27bd7e0db491: Status 404 returned error can't find the container with id 2bf6bf21e0adbdaea874a57184f406b548c1a7314ffdec09a76b27bd7e0db491
Jul 30 20:51:57.938578 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.938550    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:57.938680 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.938638    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:57.938783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:57.938681    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:51:58.113417 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.113319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerStarted","Data":"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"}
Jul 30 20:51:58.113417 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.113398    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerStarted","Data":"2bf6bf21e0adbdaea874a57184f406b548c1a7314ffdec09a76b27bd7e0db491"}
Jul 30 20:51:58.166463 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.166409    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podStartSLOduration=1.166392271 podStartE2EDuration="1.166392271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:51:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:51:58.165486444 +0000 UTC m=+1845.928406978" watchObservedRunningTime="2026-07-30 20:51:58.166392271 +0000 UTC m=+1845.929312812"
Jul 30 20:51:58.754664 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.754629    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53607fa-9851-4965-95f1-e9fc4823728b" path="/var/lib/kubelet/pods/a53607fa-9851-4965-95f1-e9fc4823728b/volumes"
Jul 30 20:51:58.764873 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.764838    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:58.769674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:58.769647    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:59.118813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:59.118722    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:59.119927 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:59.119905    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:51:59.588208 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:59.588158    2583 patch_prober.go:28] interesting pod/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:51:59.588598 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:51:59.588227    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:52:00.709449 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.709412    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:00.710051 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.710034    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:52:00.710096 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.710054    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcfe541e-963f-4931-b35d-a021a094aa73" containerName="istio-proxy"
Jul 30 20:52:00.713928 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.713906    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.716769 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.716751    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-bfe7e24b-serving-cert\""
Jul 30 20:52:00.725975 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.725946    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:00.880883 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.880841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.881060 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.880986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhkz\" (UniqueName: \"kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.881060 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.881037    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.981991 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.981962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhkz\" (UniqueName: \"kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.982133 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.982003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.982133 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.982073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.982717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.982666    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.984522 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.984494    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:00.991719 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:00.991678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhkz\" (UniqueName: \"kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz\") pod \"maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:01.024973 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.024946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:01.168465 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.168441    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:01.170552 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:52:01.170521    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7eb6d44_b5ac_4b73_9347_b3c1f2018cd3.slice/crio-fa008a0bf20b613346e51188890ee2cbaeb2b57f671a25e9ac6781f358d4b214 WatchSource:0}: Error finding container fa008a0bf20b613346e51188890ee2cbaeb2b57f671a25e9ac6781f358d4b214: Status 404 returned error can't find the container with id fa008a0bf20b613346e51188890ee2cbaeb2b57f671a25e9ac6781f358d4b214
Jul 30 20:52:01.898458 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.898429    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:52:01.991731 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991571    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.991731 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991617    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.991731 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991660    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.991731 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991695    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991735    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991762    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991858    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59r8p\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991894    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket\") pod \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\" (UID: \"b6c39f0c-80c2-4858-9d05-dcd4da02fa56\") "
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.991990    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992116    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:01.992173 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992156    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:52:01.992708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:01.992708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992474    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:01.992708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992508    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:01.992708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992535    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:01.992708 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.992550    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:01.993131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.993043    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:01.994464 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.994436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:52:01.994634 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.994551    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:01.995109 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.995078    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:52:01.995275 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:01.995254    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p" (OuterVolumeSpecName: "kube-api-access-59r8p") pod "b6c39f0c-80c2-4858-9d05-dcd4da02fa56" (UID: "b6c39f0c-80c2-4858-9d05-dcd4da02fa56"). InnerVolumeSpecName "kube-api-access-59r8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:52:02.094141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.094051    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:02.094141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.094081    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:02.094141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.094089    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:02.094141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.094098    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59r8p\" (UniqueName: \"kubernetes.io/projected/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-kube-api-access-59r8p\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:02.094141 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.094108    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6c39f0c-80c2-4858-9d05-dcd4da02fa56-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:02.137805 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.137760    2583 generic.go:356] "Generic (PLEG): container finished" podID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerID="c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f" exitCode=0
Jul 30 20:52:02.137998 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.137813    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"
Jul 30 20:52:02.137998 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.137841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerDied","Data":"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"}
Jul 30 20:52:02.137998 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.137901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp" event={"ID":"b6c39f0c-80c2-4858-9d05-dcd4da02fa56","Type":"ContainerDied","Data":"bd6f499b9eb3f77a229750f25fa4f2d9097c16b8436f0d0082ca9988198fb610"}
Jul 30 20:52:02.137998 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.137925    2583 scope.go:117] "RemoveContainer" containerID="c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"
Jul 30 20:52:02.139469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.139440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" event={"ID":"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3","Type":"ContainerStarted","Data":"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"}
Jul 30 20:52:02.139597 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.139493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" event={"ID":"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3","Type":"ContainerStarted","Data":"fa008a0bf20b613346e51188890ee2cbaeb2b57f671a25e9ac6781f358d4b214"}
Jul 30 20:52:02.139597 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.139522    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:02.147302 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.147282    2583 scope.go:117] "RemoveContainer" containerID="e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"
Jul 30 20:52:02.156391 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.156373    2583 scope.go:117] "RemoveContainer" containerID="c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"
Jul 30 20:52:02.156711 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:02.156675    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f\": container with ID starting with c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f not found: ID does not exist" containerID="c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"
Jul 30 20:52:02.156759 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.156722    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f"} err="failed to get container status \"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f\": rpc error: code = NotFound desc = could not find container \"c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f\": container with ID starting with c09c47f0bc4cbdda536e2af1b3c250b11caa92cea39e9a557978d38d609b6e6f not found: ID does not exist"
Jul 30 20:52:02.156759 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.156743    2583 scope.go:117] "RemoveContainer" containerID="e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"
Jul 30 20:52:02.156976 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:02.156960    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c\": container with ID starting with e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c not found: ID does not exist" containerID="e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"
Jul 30 20:52:02.157012 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.156983    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c"} err="failed to get container status \"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c\": rpc error: code = NotFound desc = could not find container \"e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c\": container with ID starting with e496c4c9ddd3423793ae92e001d0e160e98f6e0aee63071342948055ef1e3b4c not found: ID does not exist"
Jul 30 20:52:02.162882 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.162808    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" podStartSLOduration=1.7856694100000001 podStartE2EDuration="2.162791386s" totalImagesPullingTime="377.121976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:52:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:52:02.161377367 +0000 UTC m=+1849.924297902" watchObservedRunningTime="2026-07-30 20:52:02.162791386 +0000 UTC m=+1849.925711920"
Jul 30 20:52:02.178011 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.177969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:52:02.187862 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.187823    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1f4c9be7-gw-openshift-default-54b47b4c7b-t75xp"]
Jul 30 20:52:02.754549 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:02.754510    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" path="/var/lib/kubelet/pods/b6c39f0c-80c2-4858-9d05-dcd4da02fa56/volumes"
Jul 30 20:52:08.151537 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:08.151509    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:13.200379 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.200290    2583 generic.go:356] "Generic (PLEG): container finished" podID="c51f5592-047a-4d74-976b-6f426a3706cc" containerID="91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a" exitCode=0
Jul 30 20:52:13.200379 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.200353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerDied","Data":"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"}
Jul 30 20:52:13.200923 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.200818    2583 scope.go:117] "RemoveContainer" containerID="91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"
Jul 30 20:52:13.202037 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.202001    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:13.202149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.202103    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:13.202149 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:13.202144    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:14.118828 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:14.118788    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:14.207162 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:14.207128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerStarted","Data":"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"}
Jul 30 20:52:14.765140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:14.765106    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:14.766067 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:14.766044    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 20:52:14.766133 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:14.766094    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 20:52:15.765245 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:15.765198    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 20:52:15.765644 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:15.765266    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 20:52:16.765274 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:16.765237    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 20:52:16.765673 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:16.765291    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 20:52:17.764927 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:17.764869    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 20:52:17.765143 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:17.764930    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 20:52:18.765432 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:18.765400    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 30 20:52:18.765873 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:18.765452    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 30 20:52:19.769105 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:19.769072    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:19.769515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:19.769334    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:19.769996 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:19.769978    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:25.447235 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.447196    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"]
Jul 30 20:52:25.447656 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.447606    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:25.447656 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.447619    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:25.447771 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.447758    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:25.447813 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.447776    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:25.449929 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.449910    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:25.452732 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.452712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-58j97\""
Jul 30 20:52:25.459185 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.459157    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"]
Jul 30 20:52:25.527516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.527477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4\" (UID: \"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:25.628856 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.628817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4\" (UID: \"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:25.629458 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.629438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4\" (UID: \"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:25.761435 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.761406    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:25.898223 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:25.898197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"]
Jul 30 20:52:25.900233 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:52:25.900192    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5ebdb7_4d8e_4869_934a_22f5ade0c7c1.slice/crio-0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c WatchSource:0}: Error finding container 0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c: Status 404 returned error can't find the container with id 0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c
Jul 30 20:52:26.280441 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:26.280404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4" event={"ID":"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1","Type":"ContainerStarted","Data":"4f90ca82c2793f1bbb36c0574a58dbb5b1ba62a952bc1bbc3cd4ce00e7a74126"}
Jul 30 20:52:26.280674 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:26.280474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4" event={"ID":"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1","Type":"ContainerStarted","Data":"0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c"}
Jul 30 20:52:26.303618 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:26.303540    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4" podStartSLOduration=1.303518639 podStartE2EDuration="1.303518639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:52:26.302236017 +0000 UTC m=+1874.065156551" watchObservedRunningTime="2026-07-30 20:52:26.303518639 +0000 UTC m=+1874.066439173"
Jul 30 20:52:27.287228 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:27.287191    2583 generic.go:356] "Generic (PLEG): container finished" podID="ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" containerID="4f90ca82c2793f1bbb36c0574a58dbb5b1ba62a952bc1bbc3cd4ce00e7a74126" exitCode=0
Jul 30 20:52:27.287622 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:27.287283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4" event={"ID":"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1","Type":"ContainerDied","Data":"4f90ca82c2793f1bbb36c0574a58dbb5b1ba62a952bc1bbc3cd4ce00e7a74126"}
Jul 30 20:52:28.445536 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:28.445509    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:28.561824 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:28.561736    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca\") pod \"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1\" (UID: \"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1\") "
Jul 30 20:52:28.562156 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:28.562131    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" (UID: "ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:52:28.663416 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:28.663384    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1-maas-api-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:29.299881 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:29.299850    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"
Jul 30 20:52:29.300082 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:29.299878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4" event={"ID":"ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1","Type":"ContainerDied","Data":"0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c"}
Jul 30 20:52:29.300082 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:29.299925    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0559736c7c0765bbbbfae9478b8e81306deb9a41ddba021f87f645a4b834ce4c"
Jul 30 20:52:31.288513 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.288474    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:31.289035 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.288761    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" podUID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" containerName="maas-api" containerID="cri-o://9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9" gracePeriod=30
Jul 30 20:52:31.507940 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.507902    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"]
Jul 30 20:52:31.512119 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.512086    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bfe7e24b-r8fh4"]
Jul 30 20:52:31.544809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.544744    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:31.693004 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.692957    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca\") pod \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") "
Jul 30 20:52:31.693206 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.693077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls\") pod \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") "
Jul 30 20:52:31.693206 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.693138    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxhkz\" (UniqueName: \"kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz\") pod \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\" (UID: \"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3\") "
Jul 30 20:52:31.693396 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.693367    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" (UID: "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:52:31.693492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.693465    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:31.695371 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.695337    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz" (OuterVolumeSpecName: "kube-api-access-fxhkz") pod "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" (UID: "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3"). InnerVolumeSpecName "kube-api-access-fxhkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:52:31.695477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.695387    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" (UID: "d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:52:31.794030 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.793978    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:31.794030 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:31.794023    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxhkz\" (UniqueName: \"kubernetes.io/projected/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3-kube-api-access-fxhkz\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:32.317453 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.317417    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" containerID="9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9" exitCode=0
Jul 30 20:52:32.317921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.317469    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" event={"ID":"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3","Type":"ContainerDied","Data":"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"}
Jul 30 20:52:32.317921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.317507    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l" event={"ID":"d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3","Type":"ContainerDied","Data":"fa008a0bf20b613346e51188890ee2cbaeb2b57f671a25e9ac6781f358d4b214"}
Jul 30 20:52:32.317921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.317528    2583 scope.go:117] "RemoveContainer" containerID="9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"
Jul 30 20:52:32.317921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.317471    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"
Jul 30 20:52:32.328172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.328155    2583 scope.go:117] "RemoveContainer" containerID="9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"
Jul 30 20:52:32.328443 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:32.328427    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9\": container with ID starting with 9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9 not found: ID does not exist" containerID="9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"
Jul 30 20:52:32.328483 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.328453    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9"} err="failed to get container status \"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9\": rpc error: code = NotFound desc = could not find container \"9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9\": container with ID starting with 9e50e831cf55b4e39f8187023920a42cc3db11cee5ddb9fe412b311338d5bcc9 not found: ID does not exist"
Jul 30 20:52:32.341312 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.341280    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:32.345129 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.345103    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-bfe7e24b-664f7dc847-wgh8l"]
Jul 30 20:52:32.710494 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.710414    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:52:32.710654 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.710631    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" containerID="cri-o://7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d" gracePeriod=30
Jul 30 20:52:32.753871 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.753838    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" path="/var/lib/kubelet/pods/d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3/volumes"
Jul 30 20:52:32.754237 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:32.754220    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" path="/var/lib/kubelet/pods/ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1/volumes"
Jul 30 20:52:33.511306 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511277    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:52:33.511710 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511695    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" containerName="revoke-keys"
Jul 30 20:52:33.511710 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511710    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" containerName="revoke-keys"
Jul 30 20:52:33.511810 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511732    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" containerName="maas-api"
Jul 30 20:52:33.511810 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511739    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" containerName="maas-api"
Jul 30 20:52:33.511810 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511746    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:33.511810 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511752    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6c39f0c-80c2-4858-9d05-dcd4da02fa56" containerName="istio-proxy"
Jul 30 20:52:33.511937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511819    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7eb6d44-b5ac-4b73-9347-b3c1f2018cd3" containerName="maas-api"
Jul 30 20:52:33.511937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.511831    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea5ebdb7-4d8e-4869-934a-22f5ade0c7c1" containerName="revoke-keys"
Jul 30 20:52:33.514761 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.514741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.518458 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.518441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4cbc80de-openshift-default-dockercfg-q4gjs\""
Jul 30 20:52:33.531527 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.531500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:52:33.610550 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610939 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610939 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610939 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.610939 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.610921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqpm\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.711994 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.711956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqpm\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712197 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712463 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712463 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712463 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712285    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712463 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712456    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712660 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712503    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712814 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.712936 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.712829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.713117 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.713096    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.714338 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.714319    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.714738 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.714723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.722050 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.722014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.722294 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.722259    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqpm\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm\") pod \"e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") " pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.825585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.825482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:33.979482 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.979448    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:52:33.982813 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:52:33.982784    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5035132c_35dd_4ccb_8048_4302796b4adb.slice/crio-42007310a31c6cb00ef2b971f1bfdf01238a74dde602974b1075ab9823970cb6 WatchSource:0}: Error finding container 42007310a31c6cb00ef2b971f1bfdf01238a74dde602974b1075ab9823970cb6: Status 404 returned error can't find the container with id 42007310a31c6cb00ef2b971f1bfdf01238a74dde602974b1075ab9823970cb6
Jul 30 20:52:33.985157 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.985126    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:33.985247 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.985192    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:33.985247 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:33.985220    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:34.330775 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.330732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerStarted","Data":"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"}
Jul 30 20:52:34.330938 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.330797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerStarted","Data":"42007310a31c6cb00ef2b971f1bfdf01238a74dde602974b1075ab9823970cb6"}
Jul 30 20:52:34.354631 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.354564    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podStartSLOduration=1.354541213 podStartE2EDuration="1.354541213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:52:34.35253238 +0000 UTC m=+1882.115452915" watchObservedRunningTime="2026-07-30 20:52:34.354541213 +0000 UTC m=+1882.117461750"
Jul 30 20:52:34.772040 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.772008    2583 patch_prober.go:28] interesting pod/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 30 20:52:34.772391 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.772065    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:52:34.826502 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:34.826466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:35.831301 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:35.831267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:36.341070 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.341038    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:36.342073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.342047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:36.873304 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.873268    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:52:36.877255 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.877232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:36.880402 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.880377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-4cbc80de-serving-cert\""
Jul 30 20:52:36.895131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:36.895100    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:52:37.044553 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.044514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.044764 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.044562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtw7r\" (UniqueName: \"kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.044764 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.044627    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.145398 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.145308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.145398 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.145356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtw7r\" (UniqueName: \"kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.145668 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.145417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.145668 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:37.145445    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-serving-cert: secret "maas-api-e2e-derive-4cbc80de-serving-cert" not found
Jul 30 20:52:37.145668 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:37.145507    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls podName:e719edb3-ad1d-4ab4-bc44-39bdfe719f95 nodeName:}" failed. No retries permitted until 2026-07-30 20:52:37.645488981 +0000 UTC m=+1885.408409493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls") pod "maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" (UID: "e719edb3-ad1d-4ab4-bc44-39bdfe719f95") : secret "maas-api-e2e-derive-4cbc80de-serving-cert" not found
Jul 30 20:52:37.146135 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.146112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.154666 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.154641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtw7r\" (UniqueName: \"kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.649862 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.649828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.652270 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.652246    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") pod \"maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.791343 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.791307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:37.991964 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:37.991931    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:38.147585 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.147558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:52:38.149277 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:52:38.149238    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode719edb3_ad1d_4ab4_bc44_39bdfe719f95.slice/crio-2d0f5413c8fb8ae4467a16821aabc3e1271972317a5e71614cd1fe79fb36980c WatchSource:0}: Error finding container 2d0f5413c8fb8ae4467a16821aabc3e1271972317a5e71614cd1fe79fb36980c: Status 404 returned error can't find the container with id 2d0f5413c8fb8ae4467a16821aabc3e1271972317a5e71614cd1fe79fb36980c
Jul 30 20:52:38.155512 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155485    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155619 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155619 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155566    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155619 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155619 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155627    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155754    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155793    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.155865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155823    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm447\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447\") pod \"c51f5592-047a-4d74-976b-6f426a3706cc\" (UID: \"c51f5592-047a-4d74-976b-6f426a3706cc\") "
Jul 30 20:52:38.156172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155891    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:38.156172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.155918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:38.156172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156082    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:38.156172 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156113    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:38.156390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156212    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.156390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156230    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.156390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156243    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.156390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156257    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.156390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.156281    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:52:38.157876 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.157844    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:52:38.157987 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.157947    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:52:38.158204 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.158159    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:52:38.158382 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.158363    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447" (OuterVolumeSpecName: "kube-api-access-gm447") pod "c51f5592-047a-4d74-976b-6f426a3706cc" (UID: "c51f5592-047a-4d74-976b-6f426a3706cc"). InnerVolumeSpecName "kube-api-access-gm447". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:52:38.257154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.257113    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c51f5592-047a-4d74-976b-6f426a3706cc-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.257154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.257147    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c51f5592-047a-4d74-976b-6f426a3706cc-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.257154 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.257159    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.257421 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.257171    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c51f5592-047a-4d74-976b-6f426a3706cc-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.257421 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.257182    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm447\" (UniqueName: \"kubernetes.io/projected/c51f5592-047a-4d74-976b-6f426a3706cc-kube-api-access-gm447\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:52:38.351759 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.351718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" event={"ID":"e719edb3-ad1d-4ab4-bc44-39bdfe719f95","Type":"ContainerStarted","Data":"2d0f5413c8fb8ae4467a16821aabc3e1271972317a5e71614cd1fe79fb36980c"}
Jul 30 20:52:38.353377 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.353347    2583 generic.go:356] "Generic (PLEG): container finished" podID="c51f5592-047a-4d74-976b-6f426a3706cc" containerID="7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d" exitCode=0
Jul 30 20:52:38.353505 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.353390    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"
Jul 30 20:52:38.353505 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.353436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerDied","Data":"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"}
Jul 30 20:52:38.353505 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.353489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2" event={"ID":"c51f5592-047a-4d74-976b-6f426a3706cc","Type":"ContainerDied","Data":"2bf6bf21e0adbdaea874a57184f406b548c1a7314ffdec09a76b27bd7e0db491"}
Jul 30 20:52:38.353622 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.353515    2583 scope.go:117] "RemoveContainer" containerID="7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"
Jul 30 20:52:38.362450 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.362434    2583 scope.go:117] "RemoveContainer" containerID="91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"
Jul 30 20:52:38.371219 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.371192    2583 scope.go:117] "RemoveContainer" containerID="7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"
Jul 30 20:52:38.371531 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:38.371510    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d\": container with ID starting with 7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d not found: ID does not exist" containerID="7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"
Jul 30 20:52:38.371607 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.371541    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d"} err="failed to get container status \"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d\": rpc error: code = NotFound desc = could not find container \"7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d\": container with ID starting with 7f9c53dac05ece81cd7ac5ecfc17af080c19e277398dd475244aa3c09448cb6d not found: ID does not exist"
Jul 30 20:52:38.371607 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.371560    2583 scope.go:117] "RemoveContainer" containerID="91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"
Jul 30 20:52:38.371833 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:52:38.371816    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a\": container with ID starting with 91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a not found: ID does not exist" containerID="91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"
Jul 30 20:52:38.371880 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.371839    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a"} err="failed to get container status \"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a\": rpc error: code = NotFound desc = could not find container \"91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a\": container with ID starting with 91517b349db9a24013b6ddae7105641648f29314cceacfe61dd00952c98ad08a not found: ID does not exist"
Jul 30 20:52:38.375779 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.375751    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:52:38.380012 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.379989    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bfe7e24b-openshift-default-65d6954c5d-l4mv2"]
Jul 30 20:52:38.754201 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:38.754154    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" path="/var/lib/kubelet/pods/c51f5592-047a-4d74-976b-6f426a3706cc/volumes"
Jul 30 20:52:39.361138 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:39.361104    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" event={"ID":"e719edb3-ad1d-4ab4-bc44-39bdfe719f95","Type":"ContainerStarted","Data":"94fdc274c24ace1ddbe111e80f04fe1489cf22107ab397999d4a93a61fbd7c07"}
Jul 30 20:52:39.361556 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:39.361174    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:39.378864 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:39.378804    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" podStartSLOduration=3.050684328 podStartE2EDuration="3.378787829s" totalImagesPullingTime="328.103501ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:52:39.37743786 +0000 UTC m=+1887.140358410" watchObservedRunningTime="2026-07-30 20:52:39.378787829 +0000 UTC m=+1887.141708417"
Jul 30 20:52:45.371204 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:45.371175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:52:52.296773 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.296736    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:38534->10.133.0.46:15021: read: connection reset by peer" start-of-body=
Jul 30 20:52:52.297201 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.296829    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": read tcp 10.133.0.2:38534->10.133.0.46:15021: read: connection reset by peer"
Jul 30 20:52:52.429583 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.429550    2583 generic.go:356] "Generic (PLEG): container finished" podID="5035132c-35dd-4ccb-8048-4302796b4adb" containerID="fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b" exitCode=0
Jul 30 20:52:52.429762 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.429625    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerDied","Data":"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"}
Jul 30 20:52:52.430156 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.430136    2583 scope.go:117] "RemoveContainer" containerID="fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"
Jul 30 20:52:52.431281 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.431255    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:52.431341 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.431321    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:52.431378 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:52.431352    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:52:53.444941 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:53.444901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerStarted","Data":"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"}
Jul 30 20:52:53.826630 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:53.826595    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:53.826958 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:53.826667    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:52:53.827134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:53.827109    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 20:52:54.826861 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:54.826822    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:52:54.827469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:54.827436    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 20:52:55.826567 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:55.826520    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:52:55.826840 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:55.826590    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 20:52:56.826174 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:56.826129    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:52:56.826709 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:56.826215    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 20:52:57.827070 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:57.827028    2583 patch_prober.go:28] interesting pod/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 30 20:52:57.827922 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:57.827886    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 30 20:52:58.829395 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:58.829359    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:58.829824 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:58.829626    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:52:58.830273 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:52:58.830258    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:53:07.362627 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.362587    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:53:07.363099 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.362795    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" podUID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" containerName="maas-api" containerID="cri-o://94fdc274c24ace1ddbe111e80f04fe1489cf22107ab397999d4a93a61fbd7c07" gracePeriod=30
Jul 30 20:53:07.518546 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.518514    2583 generic.go:356] "Generic (PLEG): container finished" podID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" containerID="94fdc274c24ace1ddbe111e80f04fe1489cf22107ab397999d4a93a61fbd7c07" exitCode=0
Jul 30 20:53:07.518736 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.518584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" event={"ID":"e719edb3-ad1d-4ab4-bc44-39bdfe719f95","Type":"ContainerDied","Data":"94fdc274c24ace1ddbe111e80f04fe1489cf22107ab397999d4a93a61fbd7c07"}
Jul 30 20:53:07.631909 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.631883    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:53:07.755056 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.755020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca\") pod \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") "
Jul 30 20:53:07.755248 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.755103    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") pod \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") "
Jul 30 20:53:07.755248 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.755135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtw7r\" (UniqueName: \"kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r\") pod \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\" (UID: \"e719edb3-ad1d-4ab4-bc44-39bdfe719f95\") "
Jul 30 20:53:07.755499 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.755469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e719edb3-ad1d-4ab4-bc44-39bdfe719f95" (UID: "e719edb3-ad1d-4ab4-bc44-39bdfe719f95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:53:07.757332 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.757297    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e719edb3-ad1d-4ab4-bc44-39bdfe719f95" (UID: "e719edb3-ad1d-4ab4-bc44-39bdfe719f95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:53:07.757477 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.757369    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r" (OuterVolumeSpecName: "kube-api-access-xtw7r") pod "e719edb3-ad1d-4ab4-bc44-39bdfe719f95" (UID: "e719edb3-ad1d-4ab4-bc44-39bdfe719f95"). InnerVolumeSpecName "kube-api-access-xtw7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:53:07.856466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.856427    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:07.856466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.856457    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:07.856466 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.856468    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtw7r\" (UniqueName: \"kubernetes.io/projected/e719edb3-ad1d-4ab4-bc44-39bdfe719f95-kube-api-access-xtw7r\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:07.877399 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.877302    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:53:07.877571 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:07.877528    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy" containerID="cri-o://247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d" gracePeriod=30
Jul 30 20:53:08.525164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.525135    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"
Jul 30 20:53:08.525164 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.525160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb" event={"ID":"e719edb3-ad1d-4ab4-bc44-39bdfe719f95","Type":"ContainerDied","Data":"2d0f5413c8fb8ae4467a16821aabc3e1271972317a5e71614cd1fe79fb36980c"}
Jul 30 20:53:08.525749 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.525225    2583 scope.go:117] "RemoveContainer" containerID="94fdc274c24ace1ddbe111e80f04fe1489cf22107ab397999d4a93a61fbd7c07"
Jul 30 20:53:08.556206 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.556175    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:53:08.558437 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.558411    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-4cbc80de-95fdf49c4-8m7tb"]
Jul 30 20:53:08.754472 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:08.754441    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" path="/var/lib/kubelet/pods/e719edb3-ad1d-4ab4-bc44-39bdfe719f95/volumes"
Jul 30 20:53:13.131484 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.131412    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:53:13.312591 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.312809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.312809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312638    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.312809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312728    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.312809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312763    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.312809 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312789    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.313079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312829    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpqpm\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.313079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312866    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:13.313079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312909    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.313079 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket\") pod \"5035132c-35dd-4ccb-8048-4302796b4adb\" (UID: \"5035132c-35dd-4ccb-8048-4302796b4adb\") "
Jul 30 20:53:13.313295 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.313266    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.313354 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.312935    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data" (OuterVolumeSpecName: "istio-data") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:13.313354 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.313255    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:13.313354 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.313256    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:53:13.313473 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.313438    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:13.315158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.315123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token" (OuterVolumeSpecName: "istio-token") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:53:13.315158 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.315153    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:53:13.315350 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.315216    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:53:13.315547 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.315512    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm" (OuterVolumeSpecName: "kube-api-access-hpqpm") pod "5035132c-35dd-4ccb-8048-4302796b4adb" (UID: "5035132c-35dd-4ccb-8048-4302796b4adb"). InnerVolumeSpecName "kube-api-access-hpqpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414531    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414561    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414573    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5035132c-35dd-4ccb-8048-4302796b4adb-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414581    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414589    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414597    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpqpm\" (UniqueName: \"kubernetes.io/projected/5035132c-35dd-4ccb-8048-4302796b4adb-kube-api-access-hpqpm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414606    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5035132c-35dd-4ccb-8048-4302796b4adb-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.414621 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.414614    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5035132c-35dd-4ccb-8048-4302796b4adb-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:53:13.561442 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.561393    2583 generic.go:356] "Generic (PLEG): container finished" podID="5035132c-35dd-4ccb-8048-4302796b4adb" containerID="247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d" exitCode=0
Jul 30 20:53:13.561635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.561450    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"
Jul 30 20:53:13.561635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.561462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerDied","Data":"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"}
Jul 30 20:53:13.561635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.561525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q" event={"ID":"5035132c-35dd-4ccb-8048-4302796b4adb","Type":"ContainerDied","Data":"42007310a31c6cb00ef2b971f1bfdf01238a74dde602974b1075ab9823970cb6"}
Jul 30 20:53:13.561635 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.561562    2583 scope.go:117] "RemoveContainer" containerID="247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"
Jul 30 20:53:13.571963 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.571941    2583 scope.go:117] "RemoveContainer" containerID="fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"
Jul 30 20:53:13.581447 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.581426    2583 scope.go:117] "RemoveContainer" containerID="247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"
Jul 30 20:53:13.581775 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:53:13.581755    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d\": container with ID starting with 247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d not found: ID does not exist" containerID="247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"
Jul 30 20:53:13.581822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.581787    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d"} err="failed to get container status \"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d\": rpc error: code = NotFound desc = could not find container \"247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d\": container with ID starting with 247376b2fc6bc84d011d474459ed7cf7a4cfc51e8d1eff880f793d55ca1b715d not found: ID does not exist"
Jul 30 20:53:13.581822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.581806    2583 scope.go:117] "RemoveContainer" containerID="fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"
Jul 30 20:53:13.582064 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:53:13.582043    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b\": container with ID starting with fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b not found: ID does not exist" containerID="fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"
Jul 30 20:53:13.582116 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.582079    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b"} err="failed to get container status \"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b\": rpc error: code = NotFound desc = could not find container \"fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b\": container with ID starting with fa13e120d0876a7c033d593f0d9c97da7f1a104c2e97ab15fc801bd5792c719b not found: ID does not exist"
Jul 30 20:53:13.587947 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.587921    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:53:13.592392 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:13.592368    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4cbc80de-openshift-default-6f49ffc5d4-kgs6q"]
Jul 30 20:53:14.754399 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:53:14.754367    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" path="/var/lib/kubelet/pods/5035132c-35dd-4ccb-8048-4302796b4adb/volumes"
Jul 30 20:55:05.688419 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688385    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688809    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688825    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688846    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688855    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688891    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688897    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688909    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" containerName="maas-api"
Jul 30 20:55:05.688921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688916    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" containerName="maas-api"
Jul 30 20:55:05.689186 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688985    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e719edb3-ad1d-4ab4-bc44-39bdfe719f95" containerName="maas-api"
Jul 30 20:55:05.689186 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.688995    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.689186 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.689002    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:05.689186 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.689008    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c51f5592-047a-4d74-976b-6f426a3706cc" containerName="istio-proxy"
Jul 30 20:55:05.689186 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.689016    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:05.691928 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.691911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.695645 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.695602    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dd978c01-openshift-default-dockercfg-24f2k\""
Jul 30 20:55:05.695801 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.695781    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 20:55:05.724514 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.724480    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:55:05.819539 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.819539 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819544    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.819868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.819868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.819868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819794    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.819868 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.820075 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.820075 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvxb\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.820075 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.819954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.920921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.920871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.920921 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.920924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvxb\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921277 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921682 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921682 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921682 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921813    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.921933 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.921859    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.922498 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.922283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.923756 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.923734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.923872 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.923852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.934171 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.934141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvxb\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:05.939073 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:05.939013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token\") pod \"e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") " pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:06.002525 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:06.002492    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:06.150309 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:06.150282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:55:06.152573 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:55:06.152530    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0872d170_f816_493e_8cc3_4e2fdc30f5a8.slice/crio-9d95f0ce9a9d4ee33d71782d6f219c5efaf49f50d6eb1bff41ccbd05d9a3c520 WatchSource:0}: Error finding container 9d95f0ce9a9d4ee33d71782d6f219c5efaf49f50d6eb1bff41ccbd05d9a3c520: Status 404 returned error can't find the container with id 9d95f0ce9a9d4ee33d71782d6f219c5efaf49f50d6eb1bff41ccbd05d9a3c520
Jul 30 20:55:06.154552 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:06.154518    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:06.154637 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:06.154581    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:06.154637 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:06.154609    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:07.152339 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:07.152298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerStarted","Data":"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"}
Jul 30 20:55:07.152766 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:07.152355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerStarted","Data":"9d95f0ce9a9d4ee33d71782d6f219c5efaf49f50d6eb1bff41ccbd05d9a3c520"}
Jul 30 20:55:07.175610 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:07.175544    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podStartSLOduration=2.175521952 podStartE2EDuration="2.175521952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:55:07.17394603 +0000 UTC m=+2034.936866565" watchObservedRunningTime="2026-07-30 20:55:07.175521952 +0000 UTC m=+2034.938442487"
Jul 30 20:55:08.002828 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:08.002797    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:08.007864 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:08.007837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:08.157993 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:08.157964    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:08.158987 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:08.158967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:10.278887 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.278851    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:10.279270 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.279257    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:10.279315 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.279271    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5035132c-35dd-4ccb-8048-4302796b4adb" containerName="istio-proxy"
Jul 30 20:55:10.282714 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.282661    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.285400 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.285370    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dd978c01-serving-cert\""
Jul 30 20:55:10.292322 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.292286    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:10.363516 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.363481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.363673 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.363543    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.363673 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.363593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-687wb\" (UniqueName: \"kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.464540 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.464498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.464755 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.464557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.464755 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.464582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-687wb\" (UniqueName: \"kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.464755 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:55:10.464664    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-serving-cert: secret "maas-api-e2e-mt-dd978c01-serving-cert" not found
Jul 30 20:55:10.464870 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:55:10.464759    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls podName:dc663e84-225d-496f-b50c-448f8e7ee260 nodeName:}" failed. No retries permitted until 2026-07-30 20:55:10.964741167 +0000 UTC m=+2038.727661683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls") pod "maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" (UID: "dc663e84-225d-496f-b50c-448f8e7ee260") : secret "maas-api-e2e-mt-dd978c01-serving-cert" not found
Jul 30 20:55:10.465190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.465171    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.475799 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.475768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-687wb\" (UniqueName: \"kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.969386 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.969349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:10.971954 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:10.971927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") pod \"maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:11.195634 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:11.195602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:11.331257 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:11.331223    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:11.333225 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:55:11.333174    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc663e84_225d_496f_b50c_448f8e7ee260.slice/crio-18bf745d1d3213ef22203d000ac0d5a5f03ac27324d32d372a8f6c76a3eb2cd3 WatchSource:0}: Error finding container 18bf745d1d3213ef22203d000ac0d5a5f03ac27324d32d372a8f6c76a3eb2cd3: Status 404 returned error can't find the container with id 18bf745d1d3213ef22203d000ac0d5a5f03ac27324d32d372a8f6c76a3eb2cd3
Jul 30 20:55:12.179646 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:12.179553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" event={"ID":"dc663e84-225d-496f-b50c-448f8e7ee260","Type":"ContainerStarted","Data":"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"}
Jul 30 20:55:12.179646 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:12.179639    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" event={"ID":"dc663e84-225d-496f-b50c-448f8e7ee260","Type":"ContainerStarted","Data":"18bf745d1d3213ef22203d000ac0d5a5f03ac27324d32d372a8f6c76a3eb2cd3"}
Jul 30 20:55:12.179875 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:12.179676    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:12.197637 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:12.197586    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" podStartSLOduration=1.7870072970000002 podStartE2EDuration="2.197571122s" totalImagesPullingTime="410.563825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:55:12.197017681 +0000 UTC m=+2039.959938215" watchObservedRunningTime="2026-07-30 20:55:12.197571122 +0000 UTC m=+2039.960491655"
Jul 30 20:55:18.190528 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:18.190490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:22.232120 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.232085    2583 generic.go:356] "Generic (PLEG): container finished" podID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerID="f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0" exitCode=0
Jul 30 20:55:22.232602 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.232130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerDied","Data":"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"}
Jul 30 20:55:22.232602 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.232491    2583 scope.go:117] "RemoveContainer" containerID="f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"
Jul 30 20:55:22.233682 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.233649    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:22.233793 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.233764    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:22.233835 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:22.233801    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:55:23.158403 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:23.158365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:23.243558 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:23.243516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerStarted","Data":"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"}
Jul 30 20:55:24.002741 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:24.002704    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:24.003884 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:24.003859    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 20:55:24.004003 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:24.003906    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 20:55:25.003365 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:25.003322    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 20:55:25.003819 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:25.003382    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 20:55:26.003310 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:26.003268    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 20:55:26.003519 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:26.003333    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 20:55:27.003178 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:27.003136    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 20:55:27.003368 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:27.003195    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 20:55:28.003038 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:28.003006    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Jul 30 20:55:28.003397 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:28.003054    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Jul 30 20:55:29.006956 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:29.006923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:29.007402 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:29.007208    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:29.007919 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:29.007903    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:55:52.004925 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.004841    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:52.005502 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.005079    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" podUID="dc663e84-225d-496f-b50c-448f8e7ee260" containerName="maas-api" containerID="cri-o://699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1" gracePeriod=30
Jul 30 20:55:52.259178 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.259113    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:52.282850 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.282824    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") pod \"dc663e84-225d-496f-b50c-448f8e7ee260\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") "
Jul 30 20:55:52.283051 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.282864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-687wb\" (UniqueName: \"kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb\") pod \"dc663e84-225d-496f-b50c-448f8e7ee260\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") "
Jul 30 20:55:52.283051 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.282920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca\") pod \"dc663e84-225d-496f-b50c-448f8e7ee260\" (UID: \"dc663e84-225d-496f-b50c-448f8e7ee260\") "
Jul 30 20:55:52.283455 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.283426    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc663e84-225d-496f-b50c-448f8e7ee260" (UID: "dc663e84-225d-496f-b50c-448f8e7ee260"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:55:52.285300 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.285265    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb" (OuterVolumeSpecName: "kube-api-access-687wb") pod "dc663e84-225d-496f-b50c-448f8e7ee260" (UID: "dc663e84-225d-496f-b50c-448f8e7ee260"). InnerVolumeSpecName "kube-api-access-687wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:55:52.285300 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.285285    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc663e84-225d-496f-b50c-448f8e7ee260" (UID: "dc663e84-225d-496f-b50c-448f8e7ee260"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:55:52.384276 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.384238    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc663e84-225d-496f-b50c-448f8e7ee260-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:55:52.384276 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.384273    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc663e84-225d-496f-b50c-448f8e7ee260-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:55:52.384500 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.384285    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-687wb\" (UniqueName: \"kubernetes.io/projected/dc663e84-225d-496f-b50c-448f8e7ee260-kube-api-access-687wb\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:55:52.394670 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.394626    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc663e84-225d-496f-b50c-448f8e7ee260" containerID="699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1" exitCode=0
Jul 30 20:55:52.394822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.394671    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"
Jul 30 20:55:52.394822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.394721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" event={"ID":"dc663e84-225d-496f-b50c-448f8e7ee260","Type":"ContainerDied","Data":"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"}
Jul 30 20:55:52.394822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.394775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm" event={"ID":"dc663e84-225d-496f-b50c-448f8e7ee260","Type":"ContainerDied","Data":"18bf745d1d3213ef22203d000ac0d5a5f03ac27324d32d372a8f6c76a3eb2cd3"}
Jul 30 20:55:52.394822 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.394799    2583 scope.go:117] "RemoveContainer" containerID="699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"
Jul 30 20:55:52.405076 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.405050    2583 scope.go:117] "RemoveContainer" containerID="699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"
Jul 30 20:55:52.405408 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:55:52.405386    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1\": container with ID starting with 699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1 not found: ID does not exist" containerID="699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"
Jul 30 20:55:52.405495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.405414    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1"} err="failed to get container status \"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1\": rpc error: code = NotFound desc = could not find container \"699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1\": container with ID starting with 699230be8d5ec84e3c6691be665a479a660e49bb16c5b0e5f019957340b032a1 not found: ID does not exist"
Jul 30 20:55:52.419675 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.419638    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:52.424036 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.423997    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dd978c01-6696f8cd79-7hzsm"]
Jul 30 20:55:52.754911 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:52.754882    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc663e84-225d-496f-b50c-448f8e7ee260" path="/var/lib/kubelet/pods/dc663e84-225d-496f-b50c-448f8e7ee260/volumes"
Jul 30 20:55:58.918894 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:58.918862    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:55:58.919339 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:58.919083    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" containerID="cri-o://3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72" gracePeriod=30
Jul 30 20:55:59.010338 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:59.010297    2583 patch_prober.go:28] interesting pod/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 20:55:59.010492 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:55:59.010378    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 20:56:04.173529 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.173499    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:56:04.294515 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294535    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294638    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cvxb\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.294754 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294757    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.295140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294797    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data\") pod \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\" (UID: \"0872d170-f816-493e-8cc3-4e2fdc30f5a8\") "
Jul 30 20:56:04.295140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294939    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:56:04.295140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.294954    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:56:04.295140 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.295125    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.295318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.295144    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.295318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.295161    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:56:04.295318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.295179    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:56:04.295318 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.295228    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:56:04.296942 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.296916    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:56:04.297044 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.296977    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 20:56:04.297200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.297175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 20:56:04.297310 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.297247    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb" (OuterVolumeSpecName: "kube-api-access-2cvxb") pod "0872d170-f816-493e-8cc3-4e2fdc30f5a8" (UID: "0872d170-f816-493e-8cc3-4e2fdc30f5a8"). InnerVolumeSpecName "kube-api-access-2cvxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:56:04.396002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.395948    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.395991    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.396001    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cvxb\" (UniqueName: \"kubernetes.io/projected/0872d170-f816-493e-8cc3-4e2fdc30f5a8-kube-api-access-2cvxb\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.396010    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396002 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.396019    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.396026    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.396313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.396034    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0872d170-f816-493e-8cc3-4e2fdc30f5a8-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:56:04.460577 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.460543    2583 generic.go:356] "Generic (PLEG): container finished" podID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerID="3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72" exitCode=0
Jul 30 20:56:04.460767 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.460595    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"
Jul 30 20:56:04.460767 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.460622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerDied","Data":"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"}
Jul 30 20:56:04.460767 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.460680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk" event={"ID":"0872d170-f816-493e-8cc3-4e2fdc30f5a8","Type":"ContainerDied","Data":"9d95f0ce9a9d4ee33d71782d6f219c5efaf49f50d6eb1bff41ccbd05d9a3c520"}
Jul 30 20:56:04.460767 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.460717    2583 scope.go:117] "RemoveContainer" containerID="3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"
Jul 30 20:56:04.470606 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.470590    2583 scope.go:117] "RemoveContainer" containerID="f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"
Jul 30 20:56:04.478829 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.478808    2583 scope.go:117] "RemoveContainer" containerID="3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"
Jul 30 20:56:04.479113 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:56:04.479095    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72\": container with ID starting with 3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72 not found: ID does not exist" containerID="3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"
Jul 30 20:56:04.479151 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.479124    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72"} err="failed to get container status \"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72\": rpc error: code = NotFound desc = could not find container \"3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72\": container with ID starting with 3378d60ba70130ac73f8d462477d275bfbe4766f1f35b549cb528f5805346b72 not found: ID does not exist"
Jul 30 20:56:04.479151 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.479144    2583 scope.go:117] "RemoveContainer" containerID="f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"
Jul 30 20:56:04.479402 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:56:04.479384    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0\": container with ID starting with f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0 not found: ID does not exist" containerID="f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"
Jul 30 20:56:04.479456 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.479404    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0"} err="failed to get container status \"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0\": rpc error: code = NotFound desc = could not find container \"f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0\": container with ID starting with f77167176008d9ad0729d633a83bc72db98d7f5cf741ce328fa06ae23b3971f0 not found: ID does not exist"
Jul 30 20:56:04.483904 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.483878    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:56:04.487998 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.487974    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dd978c01-openshift-default-66677767b4-qtsgk"]
Jul 30 20:56:04.753865 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:56:04.753833    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" path="/var/lib/kubelet/pods/0872d170-f816-493e-8cc3-4e2fdc30f5a8/volumes"
Jul 30 20:58:14.886269 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886222    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc663e84-225d-496f-b50c-448f8e7ee260" containerName="maas-api"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886629    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc663e84-225d-496f-b50c-448f8e7ee260" containerName="maas-api"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886636    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886643    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886728    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886738    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc663e84-225d-496f-b50c-448f8e7ee260" containerName="maas-api"
Jul 30 20:58:14.886937 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.886744    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:14.890037 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.890012    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:14.893783 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.893752    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-78475f23-openshift-default-dockercfg-p85b7\""
Jul 30 20:58:14.894625 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.894599    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 20:58:14.911131 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:14.911093    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 20:58:15.020227 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020420 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020420 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rp6r\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020548 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.020760 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.020661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121702 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121784    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rp6r\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.122200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.121976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.122200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.122018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.122200 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.122054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.122943 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.122918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.123906 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.123548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.124265 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.124231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.124539 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.124514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.124627 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.124596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.125732 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.125679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.126912 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.126881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.136844 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.136768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rp6r\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.137414 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.137391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token\") pod \"e2e-mt-78475f23-openshift-default-69985768d8-7ctsx\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") " pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.206726 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.206652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:15.378599 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.378572    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 20:58:15.380625 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:58:15.380597    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3e19bf_0008_46b3_aa81_07a375e1b095.slice/crio-57dc7c9128e1311d35e0ee7685cc8acabf121baead9e4cdfc11c957c059cc418 WatchSource:0}: Error finding container 57dc7c9128e1311d35e0ee7685cc8acabf121baead9e4cdfc11c957c059cc418: Status 404 returned error can't find the container with id 57dc7c9128e1311d35e0ee7685cc8acabf121baead9e4cdfc11c957c059cc418
Jul 30 20:58:15.382876 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.382846    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:15.382966 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.382909    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:15.382966 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:15.382937    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:16.108224 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:16.108193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerStarted","Data":"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"}
Jul 30 20:58:16.108607 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:16.108254    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerStarted","Data":"57dc7c9128e1311d35e0ee7685cc8acabf121baead9e4cdfc11c957c059cc418"}
Jul 30 20:58:16.130005 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:16.129948    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podStartSLOduration=2.129931184 podStartE2EDuration="2.129931184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:16.127964388 +0000 UTC m=+2223.890884923" watchObservedRunningTime="2026-07-30 20:58:16.129931184 +0000 UTC m=+2223.892851718"
Jul 30 20:58:16.207498 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:16.207455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:16.212886 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:16.212860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:17.113803 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:17.113775    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:17.114751 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:17.114731    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:19.191161 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.191116    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:58:19.191759 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.191741    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:19.191759 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.191760    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0872d170-f816-493e-8cc3-4e2fdc30f5a8" containerName="istio-proxy"
Jul 30 20:58:19.194909 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.194889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.197786 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.197766    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-78475f23-serving-cert\""
Jul 30 20:58:19.205254 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.205226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:58:19.366881 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.366841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.367089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.366959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwghl\" (UniqueName: \"kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.367089 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.367032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.467716 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.467583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwghl\" (UniqueName: \"kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.467716 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.467653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.467971 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.467740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.468296 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.468274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.470224 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.470192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.478234 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.478210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwghl\" (UniqueName: \"kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl\") pod \"maas-api-e2e-mt-78475f23-66977b6d79-z5knv\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.507134 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.507102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:19.651751 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.651724    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:58:19.653994 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:58:19.653968    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd979c18_bbff_4a35_b87e_9ca9ff3477d5.slice/crio-24d301bbbf31ef8fb18fe41dec6971615e952b178d17a8aaf2940dbb276b95e9 WatchSource:0}: Error finding container 24d301bbbf31ef8fb18fe41dec6971615e952b178d17a8aaf2940dbb276b95e9: Status 404 returned error can't find the container with id 24d301bbbf31ef8fb18fe41dec6971615e952b178d17a8aaf2940dbb276b95e9
Jul 30 20:58:19.655836 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:19.655817    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 20:58:20.129359 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:20.129323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" event={"ID":"bd979c18-bbff-4a35-b87e-9ca9ff3477d5","Type":"ContainerStarted","Data":"24d301bbbf31ef8fb18fe41dec6971615e952b178d17a8aaf2940dbb276b95e9"}
Jul 30 20:58:21.136746 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:21.136711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" event={"ID":"bd979c18-bbff-4a35-b87e-9ca9ff3477d5","Type":"ContainerStarted","Data":"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"}
Jul 30 20:58:21.137181 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:21.136806    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:21.156033 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:21.155972    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" podStartSLOduration=1.4213199730000001 podStartE2EDuration="2.155953386s" totalImagesPullingTime="734.633413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:21.154127098 +0000 UTC m=+2228.917047633" watchObservedRunningTime="2026-07-30 20:58:21.155953386 +0000 UTC m=+2228.918873921"
Jul 30 20:58:27.149896 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:27.149859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:58:32.115834 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.115795    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:32.116266 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.115865    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:32.199008 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.198966    2583 generic.go:356] "Generic (PLEG): container finished" podID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerID="507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3" exitCode=0
Jul 30 20:58:32.199190 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.199011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerDied","Data":"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"}
Jul 30 20:58:32.199524 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.199503    2583 scope.go:117] "RemoveContainer" containerID="507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"
Jul 30 20:58:32.200569 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.200541    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:32.200636 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.200620    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:32.200717 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:32.200696    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 20:58:33.206969 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:33.206930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerStarted","Data":"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"}
Jul 30 20:58:34.207386 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:34.207343    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:34.207828 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:34.207599    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:34.207828 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:34.207658    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:35.207676 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:35.207636    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:35.208103 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:35.207721    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:36.207109 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:36.207064    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:36.207297 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:36.207122    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:37.207024 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:37.206988    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:37.207422 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:37.207044    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:38.208080 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:38.208039    2583 patch_prober.go:28] interesting pod/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 30 20:58:38.208487 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:38.208118    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 30 20:58:39.211086 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:39.211057    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:39.211531 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:39.211331    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:39.211952 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:39.211936    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 20:58:53.553495 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.553445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 20:58:53.557240 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.557222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.561233 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.561205    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-78475f23\"/\"openshift-service-ca.crt\""
Jul 30 20:58:53.561390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.561235    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-78475f23\"/\"kube-root-ca.crt\""
Jul 30 20:58:53.561390 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.561344    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-78475f23\"/\"e2e-lifecycle-model-78475f23-kserve-self-signed-certs\""
Jul 30 20:58:53.561481 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.561439    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-78475f23\"/\"default-dockercfg-fbnrj\""
Jul 30 20:58:53.565657 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.565635    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 20:58:53.627791 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.627752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28zr2\" (UniqueName: \"kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.628001 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.627834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.628001 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.627882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.628001 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.627939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.628001 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.627976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.628170 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.628033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729574 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729785 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28zr2\" (UniqueName: \"kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729785 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.729920 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.730046 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.729918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.730146 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.730120    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.730146 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.730137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.732043 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.732020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.732323 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.732304    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.737603 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.737579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28zr2\" (UniqueName: \"kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2\") pod \"e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") " pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:53.867997 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:53.867901    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:58:54.011014 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:54.010985    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 20:58:54.013052 ip-10-0-142-180 kubenswrapper[2583]: W0730 20:58:54.013021    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7de910a4_5fdf_422c_ac09_e73564796a8d.slice/crio-6bd484efbb2800efada70ba346ebc41d5767c6fd71836c765eebea6fe8532640 WatchSource:0}: Error finding container 6bd484efbb2800efada70ba346ebc41d5767c6fd71836c765eebea6fe8532640: Status 404 returned error can't find the container with id 6bd484efbb2800efada70ba346ebc41d5767c6fd71836c765eebea6fe8532640
Jul 30 20:58:54.329770 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:54.329733    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" event={"ID":"7de910a4-5fdf-422c-ac09-e73564796a8d","Type":"ContainerStarted","Data":"15b91912e9a74ee9765e6d0497db0cda14a027f686c3a85296247feb1980afb8"}
Jul 30 20:58:54.329980 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:54.329780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" event={"ID":"7de910a4-5fdf-422c-ac09-e73564796a8d","Type":"ContainerStarted","Data":"6bd484efbb2800efada70ba346ebc41d5767c6fd71836c765eebea6fe8532640"}
Jul 30 20:58:54.348876 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:58:54.348818    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" podStartSLOduration=1.348803207 podStartE2EDuration="1.348803207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:54.346837675 +0000 UTC m=+2262.109758223" watchObservedRunningTime="2026-07-30 20:58:54.348803207 +0000 UTC m=+2262.111723789"
Jul 30 20:59:03.868907 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:03.868852    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:59:03.868907 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:03.868923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:59:03.881373 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:03.881342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:59:04.395037 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:04.395007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 20:59:12.950770 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:12.950732    2583 scope.go:117] "RemoveContainer" containerID="4f90ca82c2793f1bbb36c0574a58dbb5b1ba62a952bc1bbc3cd4ce00e7a74126"
Jul 30 20:59:38.108605 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.108566    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:59:38.109175 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.108856    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" podUID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" containerName="maas-api" containerID="cri-o://e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1" gracePeriod=30
Jul 30 20:59:38.375993 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.375964    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:59:38.471005 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.470963    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls\") pod \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") "
Jul 30 20:59:38.471210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.471055    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca\") pod \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") "
Jul 30 20:59:38.471210 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.471084    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwghl\" (UniqueName: \"kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl\") pod \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\" (UID: \"bd979c18-bbff-4a35-b87e-9ca9ff3477d5\") "
Jul 30 20:59:38.471469 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.471444    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd979c18-bbff-4a35-b87e-9ca9ff3477d5" (UID: "bd979c18-bbff-4a35-b87e-9ca9ff3477d5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 20:59:38.473234 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.473206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl" (OuterVolumeSpecName: "kube-api-access-nwghl") pod "bd979c18-bbff-4a35-b87e-9ca9ff3477d5" (UID: "bd979c18-bbff-4a35-b87e-9ca9ff3477d5"). InnerVolumeSpecName "kube-api-access-nwghl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 20:59:38.473305 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.473272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd979c18-bbff-4a35-b87e-9ca9ff3477d5" (UID: "bd979c18-bbff-4a35-b87e-9ca9ff3477d5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 20:59:38.556055 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.556019    2583 generic.go:356] "Generic (PLEG): container finished" podID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" containerID="e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1" exitCode=0
Jul 30 20:59:38.556243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.556064    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"
Jul 30 20:59:38.556243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.556102    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" event={"ID":"bd979c18-bbff-4a35-b87e-9ca9ff3477d5","Type":"ContainerDied","Data":"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"}
Jul 30 20:59:38.556243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.556158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv" event={"ID":"bd979c18-bbff-4a35-b87e-9ca9ff3477d5","Type":"ContainerDied","Data":"24d301bbbf31ef8fb18fe41dec6971615e952b178d17a8aaf2940dbb276b95e9"}
Jul 30 20:59:38.556243 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.556180    2583 scope.go:117] "RemoveContainer" containerID="e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"
Jul 30 20:59:38.565980 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.565958    2583 scope.go:117] "RemoveContainer" containerID="e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"
Jul 30 20:59:38.566264 ip-10-0-142-180 kubenswrapper[2583]: E0730 20:59:38.566247    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1\": container with ID starting with e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1 not found: ID does not exist" containerID="e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"
Jul 30 20:59:38.566313 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.566272    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1"} err="failed to get container status \"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1\": rpc error: code = NotFound desc = could not find container \"e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1\": container with ID starting with e4267996f0b8bc08be25749dddfaf410f95b3c1d389b132be7b3d6f0e013cfa1 not found: ID does not exist"
Jul 30 20:59:38.572273 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.572253    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:59:38.572273 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.572272    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwghl\" (UniqueName: \"kubernetes.io/projected/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-kube-api-access-nwghl\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:59:38.572425 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.572283    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd979c18-bbff-4a35-b87e-9ca9ff3477d5-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 20:59:38.587645 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.587616    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:59:38.599119 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.599085    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-78475f23-66977b6d79-z5knv"]
Jul 30 20:59:38.754846 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:38.754814    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" path="/var/lib/kubelet/pods/bd979c18-bbff-4a35-b87e-9ca9ff3477d5/volumes"
Jul 30 20:59:46.535661 ip-10-0-142-180 kubenswrapper[2583]: I0730 20:59:46.535620    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 21:00:01.555169 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.555119    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" podUID="7de910a4-5fdf-422c-ac09-e73564796a8d" containerName="main" containerID="cri-o://15b91912e9a74ee9765e6d0497db0cda14a027f686c3a85296247feb1980afb8" gracePeriod=45
Jul 30 21:00:01.676323 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.676291    2583 generic.go:356] "Generic (PLEG): container finished" podID="7de910a4-5fdf-422c-ac09-e73564796a8d" containerID="15b91912e9a74ee9765e6d0497db0cda14a027f686c3a85296247feb1980afb8" exitCode=0
Jul 30 21:00:01.676487 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.676361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" event={"ID":"7de910a4-5fdf-422c-ac09-e73564796a8d","Type":"ContainerDied","Data":"15b91912e9a74ee9765e6d0497db0cda14a027f686c3a85296247feb1980afb8"}
Jul 30 21:00:01.814473 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.814407    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 21:00:01.887070 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887070 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887078    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887291 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887135    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887291 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887291 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887275    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:01.887419 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887350    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887419 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887378    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28zr2\" (UniqueName: \"kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2\") pod \"7de910a4-5fdf-422c-ac09-e73564796a8d\" (UID: \"7de910a4-5fdf-422c-ac09-e73564796a8d\") "
Jul 30 21:00:01.887419 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887406    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home" (OuterVolumeSpecName: "home") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:01.887639 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887618    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:01.887757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887742    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-home\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:01.887818 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887762    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-model-cache\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:01.887818 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.887778    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-tmp-dir\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:01.889504 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.889483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:00:01.889569 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.889487    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2" (OuterVolumeSpecName: "kube-api-access-28zr2") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "kube-api-access-28zr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:00:01.889569 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.889548    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm" (OuterVolumeSpecName: "dshm") pod "7de910a4-5fdf-422c-ac09-e73564796a8d" (UID: "7de910a4-5fdf-422c-ac09-e73564796a8d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:01.988529 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.988488    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28zr2\" (UniqueName: \"kubernetes.io/projected/7de910a4-5fdf-422c-ac09-e73564796a8d-kube-api-access-28zr2\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:01.988529 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.988522    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de910a4-5fdf-422c-ac09-e73564796a8d-tls-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:01.988529 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:01.988532    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7de910a4-5fdf-422c-ac09-e73564796a8d-dshm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:02.683509 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.683475    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"
Jul 30 21:00:02.684010 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.683498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx" event={"ID":"7de910a4-5fdf-422c-ac09-e73564796a8d","Type":"ContainerDied","Data":"6bd484efbb2800efada70ba346ebc41d5767c6fd71836c765eebea6fe8532640"}
Jul 30 21:00:02.684010 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.683559    2583 scope.go:117] "RemoveContainer" containerID="15b91912e9a74ee9765e6d0497db0cda14a027f686c3a85296247feb1980afb8"
Jul 30 21:00:02.719056 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.719017    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 21:00:02.729112 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.729081    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-78475f23/e2e-lifecycle-model-78475f23-kserve-679fc77b75-ggqzx"]
Jul 30 21:00:02.754513 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:02.754479    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de910a4-5fdf-422c-ac09-e73564796a8d" path="/var/lib/kubelet/pods/7de910a4-5fdf-422c-ac09-e73564796a8d/volumes"
Jul 30 21:00:29.796006 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:29.795968    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 21:00:29.796597 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:29.796203    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy" containerID="cri-o://cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8" gracePeriod=30
Jul 30 21:00:35.060143 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.060067    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 21:00:35.104899 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.104865    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105069 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.104918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105069 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.104950    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105069 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105069 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105047    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105086    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105138    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105135    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:35.105288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105225    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:35.105288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105556 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105338    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rp6r\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r\") pod \"5f3e19bf-0008-46b3-aa81-07a375e1b095\" (UID: \"5f3e19bf-0008-46b3-aa81-07a375e1b095\") "
Jul 30 21:00:35.105556 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105368    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:35.105556 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105413    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:35.105556 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105442    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:00:35.105814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105666    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.105814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105700    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.105814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105716    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f3e19bf-0008-46b3-aa81-07a375e1b095-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.105814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105726    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.105814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.105734    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.107420 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.107385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:00:35.107551 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.107432    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:00:35.107551 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.107489    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r" (OuterVolumeSpecName: "kube-api-access-9rp6r") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "kube-api-access-9rp6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:00:35.107736 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.107713    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f3e19bf-0008-46b3-aa81-07a375e1b095" (UID: "5f3e19bf-0008-46b3-aa81-07a375e1b095"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:00:35.206739 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.206706    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.206739 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.206734    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.206739 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.206742    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f3e19bf-0008-46b3-aa81-07a375e1b095-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.207049 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.206751    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rp6r\" (UniqueName: \"kubernetes.io/projected/5f3e19bf-0008-46b3-aa81-07a375e1b095-kube-api-access-9rp6r\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:00:35.855012 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.854975    2583 generic.go:356] "Generic (PLEG): container finished" podID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerID="cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8" exitCode=0
Jul 30 21:00:35.855197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.855026    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"
Jul 30 21:00:35.855197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.855068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerDied","Data":"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"}
Jul 30 21:00:35.855197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.855123    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx" event={"ID":"5f3e19bf-0008-46b3-aa81-07a375e1b095","Type":"ContainerDied","Data":"57dc7c9128e1311d35e0ee7685cc8acabf121baead9e4cdfc11c957c059cc418"}
Jul 30 21:00:35.855197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.855148    2583 scope.go:117] "RemoveContainer" containerID="cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"
Jul 30 21:00:35.864382 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.864364    2583 scope.go:117] "RemoveContainer" containerID="507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"
Jul 30 21:00:35.872334 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.872314    2583 scope.go:117] "RemoveContainer" containerID="cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"
Jul 30 21:00:35.872581 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:00:35.872564    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8\": container with ID starting with cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8 not found: ID does not exist" containerID="cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"
Jul 30 21:00:35.872645 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.872588    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8"} err="failed to get container status \"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8\": rpc error: code = NotFound desc = could not find container \"cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8\": container with ID starting with cde001795435cb0453611fedc2d546cd770dda7af4874cb7accca82b8a51a9a8 not found: ID does not exist"
Jul 30 21:00:35.872645 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.872605    2583 scope.go:117] "RemoveContainer" containerID="507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"
Jul 30 21:00:35.872866 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:00:35.872847    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3\": container with ID starting with 507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3 not found: ID does not exist" containerID="507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"
Jul 30 21:00:35.872909 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.872872    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3"} err="failed to get container status \"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3\": rpc error: code = NotFound desc = could not find container \"507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3\": container with ID starting with 507e2e64dff49ecc498abf4327220b43a2a5145b30a77e04c4fa8344ee7728f3 not found: ID does not exist"
Jul 30 21:00:35.877028 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.877004    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 21:00:35.880371 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:35.880348    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-78475f23-openshift-default-69985768d8-7ctsx"]
Jul 30 21:00:36.755248 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:00:36.755209    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" path="/var/lib/kubelet/pods/5f3e19bf-0008-46b3-aa81-07a375e1b095/volumes"
Jul 30 21:01:35.172412 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172335    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172789    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172803    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172815    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" containerName="maas-api"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172820    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" containerName="maas-api"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172827    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de910a4-5fdf-422c-ac09-e73564796a8d" containerName="main"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172832    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de910a4-5fdf-422c-ac09-e73564796a8d" containerName="main"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172840    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.172882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172846    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.173142 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172936    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd979c18-bbff-4a35-b87e-9ca9ff3477d5" containerName="maas-api"
Jul 30 21:01:35.173142 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172944    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de910a4-5fdf-422c-ac09-e73564796a8d" containerName="main"
Jul 30 21:01:35.173142 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172952    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.173142 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.172958    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3e19bf-0008-46b3-aa81-07a375e1b095" containerName="istio-proxy"
Jul 30 21:01:35.176135 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.176114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.181023 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.180997    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 21:01:35.181217 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.180997    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-72f733-openshift-default-dockercfg-j6wjp\""
Jul 30 21:01:35.190288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.190257    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:01:35.301358 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lswrw\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301832 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301592    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301832 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301832 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.301832 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.301673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402754 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lswrw\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.402936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403264 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.402962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403264 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.403207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403264 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.403237    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403380 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.403334    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403583 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.403559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.403742 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.403725    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.405306 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.405288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.405451 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.405432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.412157 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.412131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.412326 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.412305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lswrw\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw\") pod \"e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") " pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.486461 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.486428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:35.629227 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.629199    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:01:35.631267 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:01:35.631235    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod073c48ac_55e7_4b54_8a0f_6dc8e2686e5d.slice/crio-6f1026d2c0db257b2c613e1c751259b4a573447772104dd66fcabdbc7335310f WatchSource:0}: Error finding container 6f1026d2c0db257b2c613e1c751259b4a573447772104dd66fcabdbc7335310f: Status 404 returned error can't find the container with id 6f1026d2c0db257b2c613e1c751259b4a573447772104dd66fcabdbc7335310f
Jul 30 21:01:35.633572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.633541    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:35.633677 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.633627    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:35.633778 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:35.633679    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:36.169257 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:36.169219    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerStarted","Data":"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"}
Jul 30 21:01:36.169483 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:36.169307    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerStarted","Data":"6f1026d2c0db257b2c613e1c751259b4a573447772104dd66fcabdbc7335310f"}
Jul 30 21:01:36.486634 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:36.486596    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:36.492630 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:36.492598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:36.515222 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:36.515163    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podStartSLOduration=1.5151476910000001 podStartE2EDuration="1.515147691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:01:36.194248412 +0000 UTC m=+2423.957168972" watchObservedRunningTime="2026-07-30 21:01:36.515147691 +0000 UTC m=+2424.278068298"
Jul 30 21:01:37.174176 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:37.174142    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:37.175155 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:37.175127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:39.382193 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.382161    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:01:39.386009 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.385987    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.388745 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.388717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-72f733-serving-cert\""
Jul 30 21:01:39.400523 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.400490    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:01:39.543912 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.543867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mj45\" (UniqueName: \"kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.543912 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.543913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.544163 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.543961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.644976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.644884    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mj45\" (UniqueName: \"kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.644976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.644929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.644976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.644971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.645244 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:01:39.645061    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-serving-cert: secret "maas-api-e2e-inf-a-72f733-serving-cert" not found
Jul 30 21:01:39.645244 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:01:39.645129    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls podName:ec3a59cd-7092-4cd8-b08f-398a7497fa3f nodeName:}" failed. No retries permitted until 2026-07-30 21:01:40.145114447 +0000 UTC m=+2427.908034959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls") pod "maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" (UID: "ec3a59cd-7092-4cd8-b08f-398a7497fa3f") : secret "maas-api-e2e-inf-a-72f733-serving-cert" not found
Jul 30 21:01:39.645669 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.645649    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:39.662250 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:39.662221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mj45\" (UniqueName: \"kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:40.149824 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:40.149780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:40.152222 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:40.152200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") pod \"maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:40.297681 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:40.297642    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:40.451044 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:40.451015    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:01:40.452889 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:01:40.452860    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3a59cd_7092_4cd8_b08f_398a7497fa3f.slice/crio-9dc5402cf48c8b09e3e9c70ee65d874ad4086fed22456f68c32340c78c127efd WatchSource:0}: Error finding container 9dc5402cf48c8b09e3e9c70ee65d874ad4086fed22456f68c32340c78c127efd: Status 404 returned error can't find the container with id 9dc5402cf48c8b09e3e9c70ee65d874ad4086fed22456f68c32340c78c127efd
Jul 30 21:01:41.196891 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:41.196857    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" event={"ID":"ec3a59cd-7092-4cd8-b08f-398a7497fa3f","Type":"ContainerStarted","Data":"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"}
Jul 30 21:01:41.197073 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:41.196911    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" event={"ID":"ec3a59cd-7092-4cd8-b08f-398a7497fa3f","Type":"ContainerStarted","Data":"9dc5402cf48c8b09e3e9c70ee65d874ad4086fed22456f68c32340c78c127efd"}
Jul 30 21:01:41.197073 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:41.196991    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:41.219054 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:41.218987    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" podStartSLOduration=1.668391991 podStartE2EDuration="2.218966859s" totalImagesPullingTime="550.574868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:01:41.217010114 +0000 UTC m=+2428.979930649" watchObservedRunningTime="2026-07-30 21:01:41.218966859 +0000 UTC m=+2428.981887394"
Jul 30 21:01:47.207040 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:47.207009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:01:52.252010 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:52.251559    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:34614->10.133.0.53:15021: read: connection reset by peer" start-of-body=
Jul 30 21:01:52.252010 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:52.251655    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:34614->10.133.0.53:15021: read: connection reset by peer"
Jul 30 21:01:53.271211 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.271177    2583 generic.go:356] "Generic (PLEG): container finished" podID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerID="458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239" exitCode=0
Jul 30 21:01:53.271618 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.271251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerDied","Data":"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"}
Jul 30 21:01:53.271735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.271720    2583 scope.go:117] "RemoveContainer" containerID="458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"
Jul 30 21:01:53.272806 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.272774    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:53.272927 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.272846    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:53.272927 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:53.272877    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:01:54.277977 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:54.277944    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerStarted","Data":"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"}
Jul 30 21:01:54.487540 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:54.487497    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:54.487793 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:54.487769    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 21:01:54.487850 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:54.487823    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 21:01:55.487733 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:55.487669    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 21:01:55.488220 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:55.487758    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 21:01:56.487627 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:56.487586    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 21:01:56.487844 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:56.487644    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 21:01:57.487020 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:57.486977    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 21:01:57.487198 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:57.487042    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 21:01:58.486866 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:58.486828    2583 patch_prober.go:28] interesting pod/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 30 21:01:58.487313 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:58.486897    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 30 21:01:59.490826 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:59.490793    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:59.491334 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:59.491180    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:01:59.491901 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:01:59.491885    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:02:03.777565 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.777519    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:02:03.780507 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.780475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.783371 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.783350    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-12501c-openshift-default-dockercfg-vq726\""
Jul 30 21:02:03.793770 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.793722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:02:03.887874 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.887831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.887874 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.887877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6gs\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.887907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.887999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.888047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.888099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.888125    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.888145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.888304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.888224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.988839 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6gs\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.988990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989629 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.989750 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.989731    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.991308 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.991284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.991453 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.991435    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.996622 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.996593    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:03.996780 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:03.996743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6gs\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs\") pod \"e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") " pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:04.091210 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.091114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:04.231759 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.231731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:02:04.233805 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:02:04.233779    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafb4b25_83d3_4546_b223_eba8225314ad.slice/crio-380099a7879888ff117123db58a15d75b2c5c916e5beb57be41afb1405115543 WatchSource:0}: Error finding container 380099a7879888ff117123db58a15d75b2c5c916e5beb57be41afb1405115543: Status 404 returned error can't find the container with id 380099a7879888ff117123db58a15d75b2c5c916e5beb57be41afb1405115543
Jul 30 21:02:04.235983 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.235947    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:04.236091 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.236032    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:04.236091 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.236079    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:04.334226 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.334189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerStarted","Data":"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"}
Jul 30 21:02:04.334396 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.334252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerStarted","Data":"380099a7879888ff117123db58a15d75b2c5c916e5beb57be41afb1405115543"}
Jul 30 21:02:04.356078 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:04.355974    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podStartSLOduration=1.355954374 podStartE2EDuration="1.355954374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:04.353829625 +0000 UTC m=+2452.116750161" watchObservedRunningTime="2026-07-30 21:02:04.355954374 +0000 UTC m=+2452.118874909"
Jul 30 21:02:05.091741 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:05.091669    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:05.096847 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:05.096823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:05.338929 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:05.338895    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:05.339988 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:05.339965    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:07.492448 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.492412    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:02:07.495752 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.495732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.498526 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.498497    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-12501c-serving-cert\""
Jul 30 21:02:07.507905 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.507825    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:02:07.625843 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.625803    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.626027 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.625865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522pj\" (UniqueName: \"kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.626027 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.625977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.727476 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.727432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-522pj\" (UniqueName: \"kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.727653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.727575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.727653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.727606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.727765 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:02:07.727734    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-serving-cert: secret "maas-api-e2e-inf-b-12501c-serving-cert" not found
Jul 30 21:02:07.727802 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:02:07.727797    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls podName:8503055a-91d7-41ae-b2d8-25d14f88de36 nodeName:}" failed. No retries permitted until 2026-07-30 21:02:08.227777139 +0000 UTC m=+2455.990697668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls") pod "maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" (UID: "8503055a-91d7-41ae-b2d8-25d14f88de36") : secret "maas-api-e2e-inf-b-12501c-serving-cert" not found
Jul 30 21:02:07.728222 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.728204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:07.738476 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:07.738431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-522pj\" (UniqueName: \"kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:08.233086 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:08.233043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:08.235596 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:08.235563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") pod \"maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:08.410375 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:08.410334    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:08.550747 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:08.550547    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:02:08.553180 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:02:08.553154    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8503055a_91d7_41ae_b2d8_25d14f88de36.slice/crio-92527987d490691d8a737b2ef2d42e9ad143adf27005e55ec5049d5b4e550400 WatchSource:0}: Error finding container 92527987d490691d8a737b2ef2d42e9ad143adf27005e55ec5049d5b4e550400: Status 404 returned error can't find the container with id 92527987d490691d8a737b2ef2d42e9ad143adf27005e55ec5049d5b4e550400
Jul 30 21:02:09.362180 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:09.362091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" event={"ID":"8503055a-91d7-41ae-b2d8-25d14f88de36","Type":"ContainerStarted","Data":"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"}
Jul 30 21:02:09.362180 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:09.362147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" event={"ID":"8503055a-91d7-41ae-b2d8-25d14f88de36","Type":"ContainerStarted","Data":"92527987d490691d8a737b2ef2d42e9ad143adf27005e55ec5049d5b4e550400"}
Jul 30 21:02:09.362384 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:09.362197    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:09.379942 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:09.379888    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" podStartSLOduration=1.924898744 podStartE2EDuration="2.379869148s" totalImagesPullingTime="454.970404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:09.377395305 +0000 UTC m=+2457.140315840" watchObservedRunningTime="2026-07-30 21:02:09.379869148 +0000 UTC m=+2457.142789683"
Jul 30 21:02:15.373077 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:15.373047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:02:20.340067 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.340026    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:20.340477 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.340092    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:20.429866 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.429830    2583 generic.go:356] "Generic (PLEG): container finished" podID="dafb4b25-83d3-4546-b223-eba8225314ad" containerID="2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53" exitCode=0
Jul 30 21:02:20.430055 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.429895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerDied","Data":"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"}
Jul 30 21:02:20.430339 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.430321    2583 scope.go:117] "RemoveContainer" containerID="2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"
Jul 30 21:02:20.431370 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.431342    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:20.431428 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.431410    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:20.431474 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:20.431462    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:02:21.441854 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:21.441810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerStarted","Data":"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"}
Jul 30 21:02:22.091594 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:22.091548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:22.091819 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:22.091800    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:22.091879 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:22.091850    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:23.092599 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:23.092560    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:23.093012 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:23.092634    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:24.091539 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:24.091499    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:24.091883 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:24.091557    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:25.091720 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:25.091655    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:25.092118 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:25.091749    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:26.092241 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:26.092193    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 30 21:02:26.092765 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:26.092259    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 30 21:02:27.095473 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:27.095439    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:27.095991 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:27.095877    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:02:27.096564 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:02:27.096543    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:03:47.220863 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.220824    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:03:47.221408 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.221077    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" podUID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" containerName="maas-api" containerID="cri-o://3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed" gracePeriod=30
Jul 30 21:03:47.489918 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.489886    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:03:47.517938 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.517900    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mj45\" (UniqueName: \"kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45\") pod \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") "
Jul 30 21:03:47.518134 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.518090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") pod \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") "
Jul 30 21:03:47.518134 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.518113    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca\") pod \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\" (UID: \"ec3a59cd-7092-4cd8-b08f-398a7497fa3f\") "
Jul 30 21:03:47.518520 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.518490    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec3a59cd-7092-4cd8-b08f-398a7497fa3f" (UID: "ec3a59cd-7092-4cd8-b08f-398a7497fa3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:03:47.520116 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.520088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec3a59cd-7092-4cd8-b08f-398a7497fa3f" (UID: "ec3a59cd-7092-4cd8-b08f-398a7497fa3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:03:47.520847 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.520818    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45" (OuterVolumeSpecName: "kube-api-access-5mj45") pod "ec3a59cd-7092-4cd8-b08f-398a7497fa3f" (UID: "ec3a59cd-7092-4cd8-b08f-398a7497fa3f"). InnerVolumeSpecName "kube-api-access-5mj45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:03:47.619218 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.619172    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mj45\" (UniqueName: \"kubernetes.io/projected/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-kube-api-access-5mj45\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:47.619218 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.619218    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:47.619429 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.619234    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3a59cd-7092-4cd8-b08f-398a7497fa3f-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:47.890475 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.890436    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" containerID="3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed" exitCode=0
Jul 30 21:03:47.890653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.890488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"
Jul 30 21:03:47.890653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.890499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" event={"ID":"ec3a59cd-7092-4cd8-b08f-398a7497fa3f","Type":"ContainerDied","Data":"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"}
Jul 30 21:03:47.890653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.890554    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj" event={"ID":"ec3a59cd-7092-4cd8-b08f-398a7497fa3f","Type":"ContainerDied","Data":"9dc5402cf48c8b09e3e9c70ee65d874ad4086fed22456f68c32340c78c127efd"}
Jul 30 21:03:47.890653 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.890585    2583 scope.go:117] "RemoveContainer" containerID="3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"
Jul 30 21:03:47.900880 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.900861    2583 scope.go:117] "RemoveContainer" containerID="3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"
Jul 30 21:03:47.901193 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:03:47.901170    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed\": container with ID starting with 3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed not found: ID does not exist" containerID="3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"
Jul 30 21:03:47.901259 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.901204    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed"} err="failed to get container status \"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed\": rpc error: code = NotFound desc = could not find container \"3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed\": container with ID starting with 3af6b41e27ba07d39302b26260cd316be116daf66ebc0a04eb4ed3e936f899ed not found: ID does not exist"
Jul 30 21:03:47.918015 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.917978    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:03:47.919896 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:47.919877    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72f733-6d68c7f4f9-ztzgj"]
Jul 30 21:03:48.754401 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:48.754363    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" path="/var/lib/kubelet/pods/ec3a59cd-7092-4cd8-b08f-398a7497fa3f/volumes"
Jul 30 21:03:53.944197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:53.944161    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:03:53.944815 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:53.944436    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy" containerID="cri-o://cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0" gracePeriod=30
Jul 30 21:03:59.211401 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.211333    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:03:59.340976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.340937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.340976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.340982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341215 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341038    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341215 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341215 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341110    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341215 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341173    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341226    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341282    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:59.341441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341344    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:59.341441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341358    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lswrw\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw\") pod \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\" (UID: \"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d\") "
Jul 30 21:03:59.341748 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341591    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data" (OuterVolumeSpecName: "istio-data") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:59.341748 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341625    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:03:59.341874 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341762    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:59.341940 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341921    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.342004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341949    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.342004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341966    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.342004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341980    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.342004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.341993    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.343552 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.343520    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:03:59.343552 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.343542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token" (OuterVolumeSpecName: "istio-token") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:03:59.343552 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.343525    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw" (OuterVolumeSpecName: "kube-api-access-lswrw") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "kube-api-access-lswrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:03:59.343823 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.343644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" (UID: "073c48ac-55e7-4b54-8a0f-6dc8e2686e5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:03:59.442943 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.442894    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.442943 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.442938    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.442943 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.442949    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.442943 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.442958    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lswrw\" (UniqueName: \"kubernetes.io/projected/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d-kube-api-access-lswrw\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:03:59.961465 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.961424    2583 generic.go:356] "Generic (PLEG): container finished" podID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerID="cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0" exitCode=0
Jul 30 21:03:59.961649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.961476    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"
Jul 30 21:03:59.961649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.961511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerDied","Data":"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"}
Jul 30 21:03:59.961649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.961563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx" event={"ID":"073c48ac-55e7-4b54-8a0f-6dc8e2686e5d","Type":"ContainerDied","Data":"6f1026d2c0db257b2c613e1c751259b4a573447772104dd66fcabdbc7335310f"}
Jul 30 21:03:59.961649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.961584    2583 scope.go:117] "RemoveContainer" containerID="cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"
Jul 30 21:03:59.971741 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.971719    2583 scope.go:117] "RemoveContainer" containerID="458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"
Jul 30 21:03:59.980354 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.980332    2583 scope.go:117] "RemoveContainer" containerID="cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"
Jul 30 21:03:59.980729 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:03:59.980673    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0\": container with ID starting with cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0 not found: ID does not exist" containerID="cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"
Jul 30 21:03:59.980898 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.980734    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0"} err="failed to get container status \"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0\": rpc error: code = NotFound desc = could not find container \"cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0\": container with ID starting with cdf725962e01d19c4f92f2cdb8ec02349fde1fd5583f967c5895ce50a15f5cb0 not found: ID does not exist"
Jul 30 21:03:59.980898 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.980754    2583 scope.go:117] "RemoveContainer" containerID="458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"
Jul 30 21:03:59.981047 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:03:59.981011    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239\": container with ID starting with 458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239 not found: ID does not exist" containerID="458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"
Jul 30 21:03:59.981047 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:03:59.981035    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239"} err="failed to get container status \"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239\": rpc error: code = NotFound desc = could not find container \"458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239\": container with ID starting with 458b1620dc852895adc03634b3d4ed3a282fda7f0c3acb66582d1b250030a239 not found: ID does not exist"
Jul 30 21:04:00.007597 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:00.007565    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:04:00.020197 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:00.020165    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-72f733-openshift-default-66b47f5598-b8mfx"]
Jul 30 21:04:00.754371 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:00.754334    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" path="/var/lib/kubelet/pods/073c48ac-55e7-4b54-8a0f-6dc8e2686e5d/volumes"
Jul 30 21:04:04.855663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:04.855623    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:04:04.856129 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:04.855846    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" podUID="8503055a-91d7-41ae-b2d8-25d14f88de36" containerName="maas-api" containerID="cri-o://e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374" gracePeriod=30
Jul 30 21:04:05.328535 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.328509    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:04:05.501383 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.501337    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-522pj\" (UniqueName: \"kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj\") pod \"8503055a-91d7-41ae-b2d8-25d14f88de36\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") "
Jul 30 21:04:05.501591 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.501487    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") pod \"8503055a-91d7-41ae-b2d8-25d14f88de36\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") "
Jul 30 21:04:05.501591 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.501521    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca\") pod \"8503055a-91d7-41ae-b2d8-25d14f88de36\" (UID: \"8503055a-91d7-41ae-b2d8-25d14f88de36\") "
Jul 30 21:04:05.501974 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.501948    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8503055a-91d7-41ae-b2d8-25d14f88de36" (UID: "8503055a-91d7-41ae-b2d8-25d14f88de36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:04:05.503587 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.503558    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj" (OuterVolumeSpecName: "kube-api-access-522pj") pod "8503055a-91d7-41ae-b2d8-25d14f88de36" (UID: "8503055a-91d7-41ae-b2d8-25d14f88de36"). InnerVolumeSpecName "kube-api-access-522pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:04:05.503721 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.503602    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8503055a-91d7-41ae-b2d8-25d14f88de36" (UID: "8503055a-91d7-41ae-b2d8-25d14f88de36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:04:05.602801 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.602766    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8503055a-91d7-41ae-b2d8-25d14f88de36-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:05.602801 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.602793    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8503055a-91d7-41ae-b2d8-25d14f88de36-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:05.602801 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.602803    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-522pj\" (UniqueName: \"kubernetes.io/projected/8503055a-91d7-41ae-b2d8-25d14f88de36-kube-api-access-522pj\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:05.993720 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.993667    2583 generic.go:356] "Generic (PLEG): container finished" podID="8503055a-91d7-41ae-b2d8-25d14f88de36" containerID="e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374" exitCode=0
Jul 30 21:04:05.994231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.993722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"
Jul 30 21:04:05.994231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.993745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" event={"ID":"8503055a-91d7-41ae-b2d8-25d14f88de36","Type":"ContainerDied","Data":"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"}
Jul 30 21:04:05.994231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.993805    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc" event={"ID":"8503055a-91d7-41ae-b2d8-25d14f88de36","Type":"ContainerDied","Data":"92527987d490691d8a737b2ef2d42e9ad143adf27005e55ec5049d5b4e550400"}
Jul 30 21:04:05.994231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:05.993836    2583 scope.go:117] "RemoveContainer" containerID="e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"
Jul 30 21:04:06.003347 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:06.003328    2583 scope.go:117] "RemoveContainer" containerID="e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"
Jul 30 21:04:06.003659 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:06.003629    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374\": container with ID starting with e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374 not found: ID does not exist" containerID="e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"
Jul 30 21:04:06.003760 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:06.003668    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374"} err="failed to get container status \"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374\": rpc error: code = NotFound desc = could not find container \"e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374\": container with ID starting with e258529cb9f7ac93fada0f529993cd131f0b67ed18b5ece0112515aef5626374 not found: ID does not exist"
Jul 30 21:04:06.016397 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:06.016365    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:04:06.020740 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:06.020710    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-12501c-6f8f79677d-k8hjc"]
Jul 30 21:04:06.755787 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:06.755750    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8503055a-91d7-41ae-b2d8-25d14f88de36" path="/var/lib/kubelet/pods/8503055a-91d7-41ae-b2d8-25d14f88de36/volumes"
Jul 30 21:04:11.497664 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:11.497625    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:04:11.498105 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:11.497927    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" containerID="cri-o://b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776" gracePeriod=30
Jul 30 21:04:12.097735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.097674    2583 patch_prober.go:28] interesting pod/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:04:12.097919 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.097771    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:04:12.471740 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.471645    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:04:12.472079 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472064    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8503055a-91d7-41ae-b2d8-25d14f88de36" containerName="maas-api"
Jul 30 21:04:12.472127 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472080    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8503055a-91d7-41ae-b2d8-25d14f88de36" containerName="maas-api"
Jul 30 21:04:12.472127 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472094    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" containerName="maas-api"
Jul 30 21:04:12.472127 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472100    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" containerName="maas-api"
Jul 30 21:04:12.472127 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472121    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.472127 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472135    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472140    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472201    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3a59cd-7092-4cd8-b08f-398a7497fa3f" containerName="maas-api"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472209    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8503055a-91d7-41ae-b2d8-25d14f88de36" containerName="maas-api"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472215    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.472303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.472220    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="073c48ac-55e7-4b54-8a0f-6dc8e2686e5d" containerName="istio-proxy"
Jul 30 21:04:12.475372 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.475352    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.478740 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.478724    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-99c4a7-openshift-default-dockercfg-66whb\""
Jul 30 21:04:12.494253 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.494225    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:04:12.671836 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.671836 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671873    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hzqj\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.671993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.672011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.672035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.672258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.672082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773649 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hzqj\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.773933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.773927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.774287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.774088    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.774287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.774121    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.774287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.774158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.774287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.774275    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.774627 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.774607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.776010 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.775989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.776476 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.776453    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.782967 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.782940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.783089 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.783011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hzqj\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj\") pod \"e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") " pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.788491 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.788470    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-99c4a7-openshift-default-dockercfg-66whb\""
Jul 30 21:04:12.796679 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.796656    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:12.938902 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.938870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:04:12.943043 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:04:12.943012    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d126d8_1261_4012_aa0d_2d882def19d2.slice/crio-e1376545170d565421699dadec447ef6ba73dd65e6fc4e2b14e1bc55dda2b141 WatchSource:0}: Error finding container e1376545170d565421699dadec447ef6ba73dd65e6fc4e2b14e1bc55dda2b141: Status 404 returned error can't find the container with id e1376545170d565421699dadec447ef6ba73dd65e6fc4e2b14e1bc55dda2b141
Jul 30 21:04:12.945147 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.945116    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:12.945225 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.945187    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:12.945275 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:12.945223    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:13.033845 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:13.033812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerStarted","Data":"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"}
Jul 30 21:04:13.034006 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:13.033873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerStarted","Data":"e1376545170d565421699dadec447ef6ba73dd65e6fc4e2b14e1bc55dda2b141"}
Jul 30 21:04:13.056054 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:13.056001    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podStartSLOduration=1.055983847 podStartE2EDuration="1.055983847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:04:13.054332863 +0000 UTC m=+2580.817253421" watchObservedRunningTime="2026-07-30 21:04:13.055983847 +0000 UTC m=+2580.818904382"
Jul 30 21:04:13.797457 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:13.797422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:13.802512 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:13.802485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:14.039364 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:14.039333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:14.040420 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:14.040403    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:16.230072 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.230039    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:04:16.235325 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.235291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.236487 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.236456    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:04:16.238069 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.238036    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-99c4a7-serving-cert\""
Jul 30 21:04:16.305777 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.305734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rnv\" (UniqueName: \"kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.305934 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.305801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.305996 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.305951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.406607 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.406562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.406824 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.406626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69rnv\" (UniqueName: \"kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.406824 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.406670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.406824 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:16.406752    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-serving-cert: secret "maas-api-e2e-api-a-99c4a7-serving-cert" not found
Jul 30 21:04:16.406824 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:16.406822    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls podName:7f691174-0751-4509-8c4f-4b3484d3ecc7 nodeName:}" failed. No retries permitted until 2026-07-30 21:04:16.906804864 +0000 UTC m=+2584.669725376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls") pod "maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" (UID: "7f691174-0751-4509-8c4f-4b3484d3ecc7") : secret "maas-api-e2e-api-a-99c4a7-serving-cert" not found
Jul 30 21:04:16.407315 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.407297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.415412 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.415378    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rnv\" (UniqueName: \"kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.754172 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.754146    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:04:16.810479 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810386    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810479 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810479 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810496    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm6gs\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810525    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810546    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810594    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810634    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data\") pod \"dafb4b25-83d3-4546-b223-eba8225314ad\" (UID: \"dafb4b25-83d3-4546-b223-eba8225314ad\") "
Jul 30 21:04:16.810804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.810745    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:04:16.811159 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.811053    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:04:16.811159 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.811068    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:04:16.811159 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.811076    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.811387 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.811362    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:04:16.811456 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.811442    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:04:16.812791 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.812760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:04:16.812940 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.812865    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:04:16.813176 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.813154    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs" (OuterVolumeSpecName: "kube-api-access-gm6gs") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "kube-api-access-gm6gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:04:16.813176 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.813160    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dafb4b25-83d3-4546-b223-eba8225314ad" (UID: "dafb4b25-83d3-4546-b223-eba8225314ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:04:16.911900 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.911861    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.911975    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.911985    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.911993    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.912001    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.912009    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dafb4b25-83d3-4546-b223-eba8225314ad-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.912018    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm6gs\" (UniqueName: \"kubernetes.io/projected/dafb4b25-83d3-4546-b223-eba8225314ad-kube-api-access-gm6gs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.912027    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dafb4b25-83d3-4546-b223-eba8225314ad-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.912103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.912035    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dafb4b25-83d3-4546-b223-eba8225314ad-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:04:16.914401 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:16.914375    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") pod \"maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:17.054754 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.054714    2583 generic.go:356] "Generic (PLEG): container finished" podID="dafb4b25-83d3-4546-b223-eba8225314ad" containerID="b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776" exitCode=0
Jul 30 21:04:17.054754 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.054751    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"
Jul 30 21:04:17.054953 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.054793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerDied","Data":"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"}
Jul 30 21:04:17.054953 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.054854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx" event={"ID":"dafb4b25-83d3-4546-b223-eba8225314ad","Type":"ContainerDied","Data":"380099a7879888ff117123db58a15d75b2c5c916e5beb57be41afb1405115543"}
Jul 30 21:04:17.054953 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.054876    2583 scope.go:117] "RemoveContainer" containerID="b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"
Jul 30 21:04:17.064544 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.064528    2583 scope.go:117] "RemoveContainer" containerID="2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"
Jul 30 21:04:17.072816 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.072791    2583 scope.go:117] "RemoveContainer" containerID="b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"
Jul 30 21:04:17.073092 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:17.073070    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776\": container with ID starting with b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776 not found: ID does not exist" containerID="b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"
Jul 30 21:04:17.073147 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.073102    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776"} err="failed to get container status \"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776\": rpc error: code = NotFound desc = could not find container \"b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776\": container with ID starting with b3abf24ea80146e0ad26a7d675f56954658c81fc5e8991ccf676b4309aa4e776 not found: ID does not exist"
Jul 30 21:04:17.073147 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.073120    2583 scope.go:117] "RemoveContainer" containerID="2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"
Jul 30 21:04:17.073415 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:17.073393    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53\": container with ID starting with 2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53 not found: ID does not exist" containerID="2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"
Jul 30 21:04:17.073488 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.073421    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53"} err="failed to get container status \"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53\": rpc error: code = NotFound desc = could not find container \"2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53\": container with ID starting with 2d27ccfe2f96e9e0857cc0371b3f7e353cefdbe34c5180cf97b981b89d75ea53 not found: ID does not exist"
Jul 30 21:04:17.099729 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.099676    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:04:17.122261 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.122231    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-12501c-openshift-default-75c9879ff6-xs5jx"]
Jul 30 21:04:17.147380 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.147349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:17.286379 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.286354    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:04:17.288286 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:04:17.288259    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f691174_0751_4509_8c4f_4b3484d3ecc7.slice/crio-5f1b69361bcf3d9af93f73cd7f7c01b44d100b1289a81add71e66182c8517a58 WatchSource:0}: Error finding container 5f1b69361bcf3d9af93f73cd7f7c01b44d100b1289a81add71e66182c8517a58: Status 404 returned error can't find the container with id 5f1b69361bcf3d9af93f73cd7f7c01b44d100b1289a81add71e66182c8517a58
Jul 30 21:04:17.289752 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:17.289731    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 21:04:18.061759 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:18.061721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" event={"ID":"7f691174-0751-4509-8c4f-4b3484d3ecc7","Type":"ContainerStarted","Data":"5f1b69361bcf3d9af93f73cd7f7c01b44d100b1289a81add71e66182c8517a58"}
Jul 30 21:04:18.755240 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:18.755207    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" path="/var/lib/kubelet/pods/dafb4b25-83d3-4546-b223-eba8225314ad/volumes"
Jul 30 21:04:19.068618 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:19.068528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" event={"ID":"7f691174-0751-4509-8c4f-4b3484d3ecc7","Type":"ContainerStarted","Data":"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"}
Jul 30 21:04:19.068799 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:19.068639    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:19.084480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:19.084400    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" podStartSLOduration=2.066842254 podStartE2EDuration="3.08437801s" totalImagesPullingTime="1.017535756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:04:19.084207509 +0000 UTC m=+2586.847128056" watchObservedRunningTime="2026-07-30 21:04:19.08437801 +0000 UTC m=+2586.847298548"
Jul 30 21:04:25.078981 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:25.078950    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:04:29.040983 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.040946    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:29.041433 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.041021    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:29.124161 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.124126    2583 generic.go:356] "Generic (PLEG): container finished" podID="62d126d8-1261-4012-aa0d-2d882def19d2" containerID="e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40" exitCode=0
Jul 30 21:04:29.124342 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.124179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerDied","Data":"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"}
Jul 30 21:04:29.124609 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.124594    2583 scope.go:117] "RemoveContainer" containerID="e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"
Jul 30 21:04:29.125601 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.125572    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:29.125728 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.125650    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:29.125728 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:29.125717    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:30.138369 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:30.138328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerStarted","Data":"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"}
Jul 30 21:04:30.796997 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:30.796940    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:30.797263 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:30.797240    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:30.797314 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:30.797292    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:31.797794 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:31.797754    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:31.798199 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:31.797815    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:32.797364 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:32.797324    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:32.797542 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:32.797395    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:33.798152 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:33.798108    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:33.798562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:33.798169    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:34.797516 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:34.797432    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 30 21:04:34.797516 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:34.797485    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 30 21:04:35.802077 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:35.802045    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:35.802450 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:35.802309    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:35.802951 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:35.802930    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:04:41.019268 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.019232    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:04:41.019901 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.019873    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.019901 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.019900    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.020108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.019928    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.020108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.019937    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.020108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.020048    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.020108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.020062    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dafb4b25-83d3-4546-b223-eba8225314ad" containerName="istio-proxy"
Jul 30 21:04:41.022743 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.022720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.026415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.026384    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6e507a-openshift-default-dockercfg-xbv2f\""
Jul 30 21:04:41.035402 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.035379    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:04:41.152377 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152828 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152828 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjz7d\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152828 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.152828 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.152681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjz7d\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.253963 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.253959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.254413 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.254339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.254413 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.254389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.254529 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.254446    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.254529 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.254490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.254628 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.254562    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.256180 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.256156    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.256504 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.256483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.261896 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.261868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.262274 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.262252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjz7d\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d\") pod \"e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") " pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.336029 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.335943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:41.485122 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.485096    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:04:41.486863 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:04:41.486832    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddece4ed0_0732_440a_88ae_fd3396ce1590.slice/crio-30b81b0e976c13e437000504a7db192f8c843eaab03560832efa85c0b99744fb WatchSource:0}: Error finding container 30b81b0e976c13e437000504a7db192f8c843eaab03560832efa85c0b99744fb: Status 404 returned error can't find the container with id 30b81b0e976c13e437000504a7db192f8c843eaab03560832efa85c0b99744fb
Jul 30 21:04:41.489537 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.489506    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:41.489620 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.489573    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:41.489620 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:41.489604    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:42.203176 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:42.203134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerStarted","Data":"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"}
Jul 30 21:04:42.203572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:42.203192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerStarted","Data":"30b81b0e976c13e437000504a7db192f8c843eaab03560832efa85c0b99744fb"}
Jul 30 21:04:42.225820 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:42.225766    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podStartSLOduration=2.225749703 podStartE2EDuration="2.225749703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:04:42.222575668 +0000 UTC m=+2609.985496203" watchObservedRunningTime="2026-07-30 21:04:42.225749703 +0000 UTC m=+2609.988670236"
Jul 30 21:04:42.336833 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:42.336786    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:42.343295 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:42.343264    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:43.208620 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:43.208587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:43.209798 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:43.209776    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:45.292591 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.292552    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:04:45.296257 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.296237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.299074 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.299046    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6e507a-serving-cert\""
Jul 30 21:04:45.308252 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.308221    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:04:45.394141 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.394100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdjk\" (UniqueName: \"kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.394353 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.394218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.394353 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.394271    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.495582 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.495542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.495826 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.495595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.495826 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:45.495717    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-serving-cert: secret "maas-api-e2e-api-b-6e507a-serving-cert" not found
Jul 30 21:04:45.495826 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.495737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdjk\" (UniqueName: \"kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.495826 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:04:45.495780    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls podName:1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d nodeName:}" failed. No retries permitted until 2026-07-30 21:04:45.995763984 +0000 UTC m=+2613.758684496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls") pod "maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" (UID: "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d") : secret "maas-api-e2e-api-b-6e507a-serving-cert" not found
Jul 30 21:04:45.496309 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.496289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:45.506479 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:45.506449    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdjk\" (UniqueName: \"kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:46.000779 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:46.000740    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:46.003357 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:46.003329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") pod \"maas-api-e2e-api-b-6e507a-7fbcc55769-smblt\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:46.209722 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:46.209649    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:46.349064 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:46.349043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:04:46.351310 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:04:46.351283    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1330b4f2_4cf3_4d1d_b9bb_8a9033ea2d0d.slice/crio-304973ec009e2294f0db8e9a9b3665984d60fd1ccf980be52b25cdcd6d4387a7 WatchSource:0}: Error finding container 304973ec009e2294f0db8e9a9b3665984d60fd1ccf980be52b25cdcd6d4387a7: Status 404 returned error can't find the container with id 304973ec009e2294f0db8e9a9b3665984d60fd1ccf980be52b25cdcd6d4387a7
Jul 30 21:04:47.229829 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:47.229797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" event={"ID":"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d","Type":"ContainerStarted","Data":"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"}
Jul 30 21:04:47.230013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:47.229850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" event={"ID":"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d","Type":"ContainerStarted","Data":"304973ec009e2294f0db8e9a9b3665984d60fd1ccf980be52b25cdcd6d4387a7"}
Jul 30 21:04:47.230013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:47.229962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:47.247813 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:47.247757    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" podStartSLOduration=1.936609531 podStartE2EDuration="2.247736593s" totalImagesPullingTime="311.127062ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:04:47.246920493 +0000 UTC m=+2615.009841028" watchObservedRunningTime="2026-07-30 21:04:47.247736593 +0000 UTC m=+2615.010657127"
Jul 30 21:04:53.246243 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:53.246213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:04:58.210027 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.209932    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:04:58.210027 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.209985    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:04:58.294527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.294494    2583 generic.go:356] "Generic (PLEG): container finished" podID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerID="b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43" exitCode=0
Jul 30 21:04:58.294735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.294576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerDied","Data":"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"}
Jul 30 21:04:58.295030 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.295015    2583 scope.go:117] "RemoveContainer" containerID="b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"
Jul 30 21:04:58.296108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.296066    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:58.296231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.296151    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:58.296231 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:58.296200    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:04:59.301790 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:59.301757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerStarted","Data":"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"}
Jul 30 21:04:59.336801 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:59.336762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:04:59.336999 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:59.336887    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:04:59.336999 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:04:59.336930    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:05:00.336973 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:00.336934    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:05:00.337575 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:00.337539    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:05:01.337326 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:01.336838    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:05:01.337326 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:01.336906    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:05:02.337924 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:02.337881    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:05:02.338536 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:02.338499    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:05:03.337113 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:03.336628    2583 patch_prober.go:28] interesting pod/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 30 21:05:03.337113 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:03.336713    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 30 21:05:04.345439 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:04.345391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:05:04.345985 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:04.345934    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:05:04.346841 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:04.346821    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:05:27.830291 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:27.830250    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:05:27.830852 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:27.830521    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" podUID="7f691174-0751-4509-8c4f-4b3484d3ecc7" containerName="maas-api" containerID="cri-o://ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58" gracePeriod=30
Jul 30 21:05:28.094383 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.094305    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:05:28.126875 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.126845    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") pod \"7f691174-0751-4509-8c4f-4b3484d3ecc7\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") "
Jul 30 21:05:28.127047 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.126890    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69rnv\" (UniqueName: \"kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv\") pod \"7f691174-0751-4509-8c4f-4b3484d3ecc7\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") "
Jul 30 21:05:28.127047 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.126950    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca\") pod \"7f691174-0751-4509-8c4f-4b3484d3ecc7\" (UID: \"7f691174-0751-4509-8c4f-4b3484d3ecc7\") "
Jul 30 21:05:28.127414 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.127373    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7f691174-0751-4509-8c4f-4b3484d3ecc7" (UID: "7f691174-0751-4509-8c4f-4b3484d3ecc7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:05:28.128987 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.128956    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7f691174-0751-4509-8c4f-4b3484d3ecc7" (UID: "7f691174-0751-4509-8c4f-4b3484d3ecc7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:05:28.129125 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.129110    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv" (OuterVolumeSpecName: "kube-api-access-69rnv") pod "7f691174-0751-4509-8c4f-4b3484d3ecc7" (UID: "7f691174-0751-4509-8c4f-4b3484d3ecc7"). InnerVolumeSpecName "kube-api-access-69rnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:05:28.228527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.228486    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7f691174-0751-4509-8c4f-4b3484d3ecc7-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:28.228527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.228519    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69rnv\" (UniqueName: \"kubernetes.io/projected/7f691174-0751-4509-8c4f-4b3484d3ecc7-kube-api-access-69rnv\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:28.228527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.228530    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f691174-0751-4509-8c4f-4b3484d3ecc7-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:28.461012 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.460920    2583 generic.go:356] "Generic (PLEG): container finished" podID="7f691174-0751-4509-8c4f-4b3484d3ecc7" containerID="ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58" exitCode=0
Jul 30 21:05:28.461012 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.460957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" event={"ID":"7f691174-0751-4509-8c4f-4b3484d3ecc7","Type":"ContainerDied","Data":"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"}
Jul 30 21:05:28.461012 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.460970    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"
Jul 30 21:05:28.461248 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.461046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh" event={"ID":"7f691174-0751-4509-8c4f-4b3484d3ecc7","Type":"ContainerDied","Data":"5f1b69361bcf3d9af93f73cd7f7c01b44d100b1289a81add71e66182c8517a58"}
Jul 30 21:05:28.461248 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.461061    2583 scope.go:117] "RemoveContainer" containerID="ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"
Jul 30 21:05:28.470957 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.470936    2583 scope.go:117] "RemoveContainer" containerID="ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"
Jul 30 21:05:28.471270 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:05:28.471247    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58\": container with ID starting with ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58 not found: ID does not exist" containerID="ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"
Jul 30 21:05:28.471336 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.471279    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58"} err="failed to get container status \"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58\": rpc error: code = NotFound desc = could not find container \"ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58\": container with ID starting with ca791b918cb2bafed1737cecdbaac8da798c0a1fb082607ca4b3528a36a01d58 not found: ID does not exist"
Jul 30 21:05:28.483652 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.483628    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:05:28.491539 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.491514    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-99c4a7-575df4b5b7-lx7lh"]
Jul 30 21:05:28.754493 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:28.754456    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f691174-0751-4509-8c4f-4b3484d3ecc7" path="/var/lib/kubelet/pods/7f691174-0751-4509-8c4f-4b3484d3ecc7/volumes"
Jul 30 21:05:34.406785 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:34.406747    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:05:34.407331 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:34.407006    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" containerID="cri-o://5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3" gracePeriod=30
Jul 30 21:05:35.804603 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:35.804557    2583 patch_prober.go:28] interesting pod/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:05:35.805031 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:35.804617    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:05:39.669958 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.669930    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:05:39.741042 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741013    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741235 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741091    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741235 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741121    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741235 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741235 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741205    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741235 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741236    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hzqj\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741284    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741351    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert\") pod \"62d126d8-1261-4012-aa0d-2d882def19d2\" (UID: \"62d126d8-1261-4012-aa0d-2d882def19d2\") "
Jul 30 21:05:39.741505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741461    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:05:39.741505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:05:39.741814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741519    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:05:39.741814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741724    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:05:39.741814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741789    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.741814 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741812    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.741979 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741823    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:05:39.741979 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.741829    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.743369 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.743349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:05:39.743466 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.743440    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:05:39.743953 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.743927    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj" (OuterVolumeSpecName: "kube-api-access-8hzqj") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "kube-api-access-8hzqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:05:39.744055 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.743949    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62d126d8-1261-4012-aa0d-2d882def19d2" (UID: "62d126d8-1261-4012-aa0d-2d882def19d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:05:39.843013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.842968    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.843013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.843003    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hzqj\" (UniqueName: \"kubernetes.io/projected/62d126d8-1261-4012-aa0d-2d882def19d2-kube-api-access-8hzqj\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.843013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.843014    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.843013 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.843022    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62d126d8-1261-4012-aa0d-2d882def19d2-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.843271 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.843031    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62d126d8-1261-4012-aa0d-2d882def19d2-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:39.843271 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:39.843038    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62d126d8-1261-4012-aa0d-2d882def19d2-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:40.525583 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.525548    2583 generic.go:356] "Generic (PLEG): container finished" podID="62d126d8-1261-4012-aa0d-2d882def19d2" containerID="5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3" exitCode=0
Jul 30 21:05:40.525791 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.525596    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"
Jul 30 21:05:40.525791 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.525618    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerDied","Data":"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"}
Jul 30 21:05:40.525791 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.525663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h" event={"ID":"62d126d8-1261-4012-aa0d-2d882def19d2","Type":"ContainerDied","Data":"e1376545170d565421699dadec447ef6ba73dd65e6fc4e2b14e1bc55dda2b141"}
Jul 30 21:05:40.525791 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.525706    2583 scope.go:117] "RemoveContainer" containerID="5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"
Jul 30 21:05:40.535739 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.535721    2583 scope.go:117] "RemoveContainer" containerID="e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"
Jul 30 21:05:40.544091 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.544068    2583 scope.go:117] "RemoveContainer" containerID="5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"
Jul 30 21:05:40.544396 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:05:40.544374    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3\": container with ID starting with 5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3 not found: ID does not exist" containerID="5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"
Jul 30 21:05:40.544444 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.544406    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3"} err="failed to get container status \"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3\": rpc error: code = NotFound desc = could not find container \"5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3\": container with ID starting with 5f4bbdda2439421c87683cb2749a1cd9b725f0a7ace17d9469037e8689ec48c3 not found: ID does not exist"
Jul 30 21:05:40.544444 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.544425    2583 scope.go:117] "RemoveContainer" containerID="e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"
Jul 30 21:05:40.544675 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:05:40.544657    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40\": container with ID starting with e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40 not found: ID does not exist" containerID="e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"
Jul 30 21:05:40.544742 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.544695    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40"} err="failed to get container status \"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40\": rpc error: code = NotFound desc = could not find container \"e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40\": container with ID starting with e9c6696a9c1a9c9d971ef53fda6173fb95c7186fef50e95222aa568ffe7b6e40 not found: ID does not exist"
Jul 30 21:05:40.549169 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.549144    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:05:40.552637 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.552615    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-99c4a7-openshift-default-5c998bd64b-fdj6h"]
Jul 30 21:05:40.754320 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:40.754283    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" path="/var/lib/kubelet/pods/62d126d8-1261-4012-aa0d-2d882def19d2/volumes"
Jul 30 21:05:50.252929 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.252885    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:05:50.253778 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.253709    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" podUID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" containerName="maas-api" containerID="cri-o://24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0" gracePeriod=30
Jul 30 21:05:50.510170 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.510099    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:05:50.579882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.579843    2583 generic.go:356] "Generic (PLEG): container finished" podID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" containerID="24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0" exitCode=0
Jul 30 21:05:50.580059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.579887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" event={"ID":"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d","Type":"ContainerDied","Data":"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"}
Jul 30 21:05:50.580059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.579948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt" event={"ID":"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d","Type":"ContainerDied","Data":"304973ec009e2294f0db8e9a9b3665984d60fd1ccf980be52b25cdcd6d4387a7"}
Jul 30 21:05:50.580059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.579960    2583 scope.go:117] "RemoveContainer" containerID="24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"
Jul 30 21:05:50.580059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.579895    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"
Jul 30 21:05:50.589741 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.589711    2583 scope.go:117] "RemoveContainer" containerID="24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"
Jul 30 21:05:50.590066 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:05:50.590045    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0\": container with ID starting with 24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0 not found: ID does not exist" containerID="24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"
Jul 30 21:05:50.590128 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.590082    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0"} err="failed to get container status \"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0\": rpc error: code = NotFound desc = could not find container \"24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0\": container with ID starting with 24b900b7a2636b5d898254f0a79fe915cf9952285d1b2eb2319dba5d9ba20ae0 not found: ID does not exist"
Jul 30 21:05:50.648355 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.648314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca\") pod \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") "
Jul 30 21:05:50.648548 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.648363    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcdjk\" (UniqueName: \"kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk\") pod \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") "
Jul 30 21:05:50.648548 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.648497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") pod \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\" (UID: \"1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d\") "
Jul 30 21:05:50.648779 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.648750    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" (UID: "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:05:50.650561 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.650531    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk" (OuterVolumeSpecName: "kube-api-access-kcdjk") pod "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" (UID: "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d"). InnerVolumeSpecName "kube-api-access-kcdjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:05:50.650719 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.650553    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" (UID: "1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:05:50.749249 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.749210    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:50.749249 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.749243    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:50.749249 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.749255    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcdjk\" (UniqueName: \"kubernetes.io/projected/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d-kube-api-access-kcdjk\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:05:50.897030 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.896990    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:05:50.901559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:50.901528    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6e507a-7fbcc55769-smblt"]
Jul 30 21:05:52.754378 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:52.754342    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" path="/var/lib/kubelet/pods/1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d/volumes"
Jul 30 21:05:56.925872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:56.925837    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:05:56.926352 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:56.926101    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy" containerID="cri-o://412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60" gracePeriod=30
Jul 30 21:05:57.873180 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873143    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:05:57.873614 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873601    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" containerName="maas-api"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873618    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" containerName="maas-api"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873632    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873638    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873645    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873651    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873663 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873664    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f691174-0751-4509-8c4f-4b3484d3ecc7" containerName="maas-api"
Jul 30 21:05:57.873872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873670    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f691174-0751-4509-8c4f-4b3484d3ecc7" containerName="maas-api"
Jul 30 21:05:57.873872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873745    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873753    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f691174-0751-4509-8c4f-4b3484d3ecc7" containerName="maas-api"
Jul 30 21:05:57.873872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="62d126d8-1261-4012-aa0d-2d882def19d2" containerName="istio-proxy"
Jul 30 21:05:57.873872 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.873769    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1330b4f2-4cf3-4d1d-b9bb-8a9033ea2d0d" containerName="maas-api"
Jul 30 21:05:57.876793 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.876771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:57.879365 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.879343    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-55df2b-openshift-default-dockercfg-l5vtq\""
Jul 30 21:05:57.888351 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:57.888327    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:05:58.020406 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020357    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pw7m\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.020795 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.020664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121681 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121743    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.121910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122177 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121913    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pw7m\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122177 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122177 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.121995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122342 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.122220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122342 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.122278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122450 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.122374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122450 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.122425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.122896 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.122867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.124285 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.124228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.124525 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.124509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.130068 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.130040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.130516 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.130500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pw7m\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m\") pod \"e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") " pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.188101 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.188065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:58.337865 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.337832    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:05:58.340155 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:05:58.340128    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7788ea_ce11_4732_b85f_3a6cb63e7134.slice/crio-ba3c0d4fa0dd666e7e3a4a0dfadfe7dd99afd3607cf9c04147fa2076a7907946 WatchSource:0}: Error finding container ba3c0d4fa0dd666e7e3a4a0dfadfe7dd99afd3607cf9c04147fa2076a7907946: Status 404 returned error can't find the container with id ba3c0d4fa0dd666e7e3a4a0dfadfe7dd99afd3607cf9c04147fa2076a7907946
Jul 30 21:05:58.342245 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.342212    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:05:58.342367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.342295    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:05:58.342367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.342345    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:05:58.623352 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.623311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerStarted","Data":"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"}
Jul 30 21:05:58.623505 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.623377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerStarted","Data":"ba3c0d4fa0dd666e7e3a4a0dfadfe7dd99afd3607cf9c04147fa2076a7907946"}
Jul 30 21:05:58.648154 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:58.648057    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podStartSLOduration=1.648040505 podStartE2EDuration="1.648040505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:05:58.646449919 +0000 UTC m=+2686.409370455" watchObservedRunningTime="2026-07-30 21:05:58.648040505 +0000 UTC m=+2686.410961039"
Jul 30 21:05:59.189095 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:59.189056    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:59.194151 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:59.194124    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:59.629203 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:59.629173    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:05:59.630095 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:05:59.630073    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:01.809507 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.809467    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:06:01.813084 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.813063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.815920 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.815898    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-55df2b-serving-cert\""
Jul 30 21:06:01.823600 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.823549    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:06:01.852166 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.852127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzvp\" (UniqueName: \"kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.852323 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.852181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.852323 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.852303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.953251 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.953208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzvp\" (UniqueName: \"kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.953399 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.953258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.953399 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.953329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.953470 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:06:01.953448    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-serving-cert: secret "maas-api-e2e-shared-a-55df2b-serving-cert" not found
Jul 30 21:06:01.953520 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:06:01.953510    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls podName:5d5118b4-c1e0-4114-ab50-b573154228f1 nodeName:}" failed. No retries permitted until 2026-07-30 21:06:02.453491655 +0000 UTC m=+2690.216412168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls") pod "maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" (UID: "5d5118b4-c1e0-4114-ab50-b573154228f1") : secret "maas-api-e2e-shared-a-55df2b-serving-cert" not found
Jul 30 21:06:01.953990 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.953970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:01.964100 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:01.964067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzvp\" (UniqueName: \"kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:02.176516 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.176489    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:06:02.255978 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.255941    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.255978 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.255976    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256202 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256004    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256202 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256035    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256202 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256148    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256202 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256193    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjz7d\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256286    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data" (OuterVolumeSpecName: "istio-data") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256300    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256346    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket\") pod \"dece4ed0-0732-440a-88ae-fd3396ce1590\" (UID: \"dece4ed0-0732-440a-88ae-fd3396ce1590\") "
Jul 30 21:06:02.256415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:06:02.256766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:06:02.256766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256742    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dece4ed0-0732-440a-88ae-fd3396ce1590-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.256766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256756    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.256766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256758    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:06:02.256989 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256771    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.256989 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.256802    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.258426 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.258403    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token" (OuterVolumeSpecName: "istio-token") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:06:02.258426 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.258408    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:06:02.258587 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.258459    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d" (OuterVolumeSpecName: "kube-api-access-rjz7d") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "kube-api-access-rjz7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:06:02.258587 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.258484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dece4ed0-0732-440a-88ae-fd3396ce1590" (UID: "dece4ed0-0732-440a-88ae-fd3396ce1590"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:06:02.357480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.357395    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.357480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.357422    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.357480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.357432    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjz7d\" (UniqueName: \"kubernetes.io/projected/dece4ed0-0732-440a-88ae-fd3396ce1590-kube-api-access-rjz7d\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.357480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.357443    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dece4ed0-0732-440a-88ae-fd3396ce1590-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.357480 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.357452    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dece4ed0-0732-440a-88ae-fd3396ce1590-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:06:02.458038 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.458001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:02.460622 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.460596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") pod \"maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:02.645788 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.645678    2583 generic.go:356] "Generic (PLEG): container finished" podID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerID="412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60" exitCode=0
Jul 30 21:06:02.645788 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.645734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerDied","Data":"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"}
Jul 30 21:06:02.645788 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.645755    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"
Jul 30 21:06:02.646075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.645833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx" event={"ID":"dece4ed0-0732-440a-88ae-fd3396ce1590","Type":"ContainerDied","Data":"30b81b0e976c13e437000504a7db192f8c843eaab03560832efa85c0b99744fb"}
Jul 30 21:06:02.646075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.645866    2583 scope.go:117] "RemoveContainer" containerID="412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"
Jul 30 21:06:02.655361 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.655343    2583 scope.go:117] "RemoveContainer" containerID="b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"
Jul 30 21:06:02.663536 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.663514    2583 scope.go:117] "RemoveContainer" containerID="412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"
Jul 30 21:06:02.663810 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:06:02.663790    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60\": container with ID starting with 412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60 not found: ID does not exist" containerID="412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"
Jul 30 21:06:02.663904 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.663819    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60"} err="failed to get container status \"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60\": rpc error: code = NotFound desc = could not find container \"412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60\": container with ID starting with 412508fdac8752eb1a8f42e321ca91cb9ad7affab55208c6a0f6167c68c90e60 not found: ID does not exist"
Jul 30 21:06:02.663904 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.663837    2583 scope.go:117] "RemoveContainer" containerID="b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"
Jul 30 21:06:02.664105 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:06:02.664084    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43\": container with ID starting with b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43 not found: ID does not exist" containerID="b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"
Jul 30 21:06:02.664152 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.664111    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43"} err="failed to get container status \"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43\": rpc error: code = NotFound desc = could not find container \"b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43\": container with ID starting with b74535e02c5d7cf1225572a8669cd5f7121b77ee4a4b44a46bb801ddce499b43 not found: ID does not exist"
Jul 30 21:06:02.669360 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.669328    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:06:02.673915 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.673887    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6e507a-openshift-default-57fdcccdf4-72jvx"]
Jul 30 21:06:02.725558 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.725525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:02.754778 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.754746    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" path="/var/lib/kubelet/pods/dece4ed0-0732-440a-88ae-fd3396ce1590/volumes"
Jul 30 21:06:02.868718 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:02.868601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:06:02.871073 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:06:02.871045    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d5118b4_c1e0_4114_ab50_b573154228f1.slice/crio-bb9324b45a88318d1b38bde5d2a0bbe323a3234b980e16b64af1ecb473eb52dd WatchSource:0}: Error finding container bb9324b45a88318d1b38bde5d2a0bbe323a3234b980e16b64af1ecb473eb52dd: Status 404 returned error can't find the container with id bb9324b45a88318d1b38bde5d2a0bbe323a3234b980e16b64af1ecb473eb52dd
Jul 30 21:06:03.653498 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:03.653464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" event={"ID":"5d5118b4-c1e0-4114-ab50-b573154228f1","Type":"ContainerStarted","Data":"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"}
Jul 30 21:06:03.653658 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:03.653517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" event={"ID":"5d5118b4-c1e0-4114-ab50-b573154228f1","Type":"ContainerStarted","Data":"bb9324b45a88318d1b38bde5d2a0bbe323a3234b980e16b64af1ecb473eb52dd"}
Jul 30 21:06:03.653658 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:03.653559    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:03.674014 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:03.673962    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" podStartSLOduration=2.327182527 podStartE2EDuration="2.673946283s" totalImagesPullingTime="346.763756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:06:03.671735293 +0000 UTC m=+2691.434655833" watchObservedRunningTime="2026-07-30 21:06:03.673946283 +0000 UTC m=+2691.436866817"
Jul 30 21:06:09.666281 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:09.666206    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:06:13.718324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.718241    2583 generic.go:356] "Generic (PLEG): container finished" podID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerID="dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f" exitCode=0
Jul 30 21:06:13.718324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.718280    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerDied","Data":"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"}
Jul 30 21:06:13.718808 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.718707    2583 scope.go:117] "RemoveContainer" containerID="dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"
Jul 30 21:06:13.719727 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.719681    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:13.719804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.719770    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:13.719842 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:13.719803    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:14.629985 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:14.629943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:14.729244 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:14.729191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerStarted","Data":"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"}
Jul 30 21:06:15.189362 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:15.189323    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:15.190476 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:15.190447    2583 patch_prober.go:28] interesting pod/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 21:06:15.190631 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:15.190521    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 21:06:16.188733 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:16.188678    2583 patch_prober.go:28] interesting pod/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 21:06:16.189148 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:16.188769    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 21:06:17.189562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:17.189518    2583 patch_prober.go:28] interesting pod/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 21:06:17.190000 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:17.189582    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 21:06:18.188909 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:18.188870    2583 patch_prober.go:28] interesting pod/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 21:06:18.189098 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:18.188929    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 21:06:19.189073 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:19.189035    2583 patch_prober.go:28] interesting pod/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 30 21:06:19.189556 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:19.189527    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 30 21:06:20.192810 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:20.192773    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:20.193257 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:20.193050    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:20.193721 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:20.193705    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:06:26.383602 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.383557    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:06:26.384031 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.383991    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.384031 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.384005    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.384031 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.384022    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.384031 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.384029    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.384185 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.384101    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.384185 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.384111    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dece4ed0-0732-440a-88ae-fd3396ce1590" containerName="istio-proxy"
Jul 30 21:06:26.386346 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.386325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.389180 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.389160    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e226df-openshift-default-dockercfg-lh9jm\""
Jul 30 21:06:26.398351 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.398321    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:06:26.494188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494150    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494393 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494210    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494393 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzg85\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494393 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494574 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494574 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494679 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494679 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.494679 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.494641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.595958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596004 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzg85\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596565 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596565 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596565 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596887 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.596976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.596938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.597042 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.597025    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.598322 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.598303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.598617 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.598597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.603914 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.603892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.604037 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.604020    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzg85\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85\") pod \"e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") " pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.697255 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.697159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:26.835512 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.835479    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:06:26.838002 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:06:26.837972    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62a8323_6948_4236_b42c_291a2636a496.slice/crio-342e8e119a8cabbd6eed5a1b2edd5670e0ab8c5d62156061023f90af3e468b8b WatchSource:0}: Error finding container 342e8e119a8cabbd6eed5a1b2edd5670e0ab8c5d62156061023f90af3e468b8b: Status 404 returned error can't find the container with id 342e8e119a8cabbd6eed5a1b2edd5670e0ab8c5d62156061023f90af3e468b8b
Jul 30 21:06:26.840342 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.840309    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:26.840458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.840394    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:26.840458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:26.840440    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:27.805381 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:27.805344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerStarted","Data":"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"}
Jul 30 21:06:27.805823 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:27.805404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerStarted","Data":"342e8e119a8cabbd6eed5a1b2edd5670e0ab8c5d62156061023f90af3e468b8b"}
Jul 30 21:06:27.825250 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:27.825188    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podStartSLOduration=1.825166815 podStartE2EDuration="1.825166815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:06:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:06:27.82502043 +0000 UTC m=+2715.587940988" watchObservedRunningTime="2026-07-30 21:06:27.825166815 +0000 UTC m=+2715.588087351"
Jul 30 21:06:28.697522 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:28.697486    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:28.702589 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:28.702563    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:28.810276 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:28.810247    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:28.811167 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:28.811148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:30.892965 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:30.892926    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:06:30.896178 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:30.896159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:30.898931 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:30.898908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e226df-serving-cert\""
Jul 30 21:06:30.906512 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:30.906481    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:06:31.040034 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.040000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.040034 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.040047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.040484 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.040109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzf49\" (UniqueName: \"kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.141572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.141533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.141572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.141581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.141834 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.141623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzf49\" (UniqueName: \"kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.142277 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.142247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.144124 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.144076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.150253 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.150233    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzf49\" (UniqueName: \"kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49\") pod \"maas-api-e2e-shared-b-e226df-6f889487df-lsmrz\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.209097 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.209058    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:31.344320 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.344294    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:06:31.347089 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:06:31.347060    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode290c246_cd67_4ab6_aab6_f6e136e7001e.slice/crio-a03e84dd5e6b4d7a798bd0ecb6c17de88ea6f1d4db5eef2074e99bbb7dfd6bf3 WatchSource:0}: Error finding container a03e84dd5e6b4d7a798bd0ecb6c17de88ea6f1d4db5eef2074e99bbb7dfd6bf3: Status 404 returned error can't find the container with id a03e84dd5e6b4d7a798bd0ecb6c17de88ea6f1d4db5eef2074e99bbb7dfd6bf3
Jul 30 21:06:31.826188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:31.826162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" event={"ID":"e290c246-cd67-4ab6-aab6-f6e136e7001e","Type":"ContainerStarted","Data":"a03e84dd5e6b4d7a798bd0ecb6c17de88ea6f1d4db5eef2074e99bbb7dfd6bf3"}
Jul 30 21:06:32.832502 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:32.832469    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" event={"ID":"e290c246-cd67-4ab6-aab6-f6e136e7001e","Type":"ContainerStarted","Data":"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"}
Jul 30 21:06:32.832931 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:32.832557    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:32.853293 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:32.853228    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" podStartSLOduration=2.378327333 podStartE2EDuration="2.853203236s" totalImagesPullingTime="474.875903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:06:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:06:32.849556774 +0000 UTC m=+2720.612477310" watchObservedRunningTime="2026-07-30 21:06:32.853203236 +0000 UTC m=+2720.616123770"
Jul 30 21:06:38.846248 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:38.846217    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:06:43.811656 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.811614    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:43.812136 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.811731    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:43.892976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.892897    2583 generic.go:356] "Generic (PLEG): container finished" podID="a62a8323-6948-4236-b42c-291a2636a496" containerID="d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41" exitCode=0
Jul 30 21:06:43.893136 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.892969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerDied","Data":"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"}
Jul 30 21:06:43.893406 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.893386    2583 scope.go:117] "RemoveContainer" containerID="d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"
Jul 30 21:06:43.894431 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.894402    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:43.894555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.894484    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:43.894555 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:43.894538    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:06:44.899956 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:44.899917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerStarted","Data":"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"}
Jul 30 21:06:45.698223 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:45.698182    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:45.698408 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:45.698389    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:45.698456 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:45.698431    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:46.697587 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:46.697553    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:46.698041 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:46.697605    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:47.697828 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:47.697787    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:47.698221 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:47.697854    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:48.698052 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:48.698010    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:48.698490 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:48.698082    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:49.698429 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:49.698392    2583 patch_prober.go:28] interesting pod/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 30 21:06:49.698859 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:49.698454    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 30 21:06:50.701844 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:50.701811    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:50.702325 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:50.702204    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:06:50.702981 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:06:50.702961    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:07:22.955485 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.955448    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:07:22.958242 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.958218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:22.961034 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.961002    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e226df\"/\"kube-root-ca.crt\""
Jul 30 21:07:22.962336 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.962312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e226df\"/\"openshift-service-ca.crt\""
Jul 30 21:07:22.962477 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.962318    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e226df\"/\"auth-test-model-e226df-kserve-self-signed-certs\""
Jul 30 21:07:22.962477 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.962322    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e226df\"/\"default-dockercfg-46q8q\""
Jul 30 21:07:22.967311 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:22.967280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:07:23.070781 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.070747    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.070960 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.070822    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.070960 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.070882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.071035 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.070966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7dq\" (UniqueName: \"kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.071035 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.070997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.071035 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.071017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172090 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172279 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172150    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7dq\" (UniqueName: \"kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172279 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172279 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172203    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172451 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172451 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172804 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.172936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.172915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.174740 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.174677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.174976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.174960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.180238 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.180218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7dq\" (UniqueName: \"kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq\") pod \"auth-test-model-e226df-kserve-5dcbcbd699-jdg6n\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") " pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.269210 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.269171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:23.409610 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:23.409576    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:07:23.411583 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:07:23.411558    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4c1f38d_55b3_4cb9_bb97_b416bfeb3c66.slice/crio-0f580368bc76bd93f9731b88181b5ed56fd3754f63d485035d2c491252ae74fd WatchSource:0}: Error finding container 0f580368bc76bd93f9731b88181b5ed56fd3754f63d485035d2c491252ae74fd: Status 404 returned error can't find the container with id 0f580368bc76bd93f9731b88181b5ed56fd3754f63d485035d2c491252ae74fd
Jul 30 21:07:24.106882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:24.106839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" event={"ID":"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66","Type":"ContainerStarted","Data":"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"}
Jul 30 21:07:24.107303 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:24.106890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" event={"ID":"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66","Type":"ContainerStarted","Data":"0f580368bc76bd93f9731b88181b5ed56fd3754f63d485035d2c491252ae74fd"}
Jul 30 21:07:24.124865 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:24.124804    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" podStartSLOduration=2.124787436 podStartE2EDuration="2.124787436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:07:24.122558962 +0000 UTC m=+2771.885479500" watchObservedRunningTime="2026-07-30 21:07:24.124787436 +0000 UTC m=+2771.887708021"
Jul 30 21:07:33.269385 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:33.269342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:33.269846 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:33.269395    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:33.282151 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:33.282123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:07:34.173546 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:07:34.173514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:11:22.152124 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:22.152084    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:11:37.172363 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.172297    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" podUID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" containerName="main" containerID="cri-o://10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796" gracePeriod=45
Jul 30 21:11:37.429507 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.429442    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:11:37.449244 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.449204    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" containerID="10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796" exitCode=0
Jul 30 21:11:37.449460 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.449282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" event={"ID":"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66","Type":"ContainerDied","Data":"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"}
Jul 30 21:11:37.449460 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.449311    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"
Jul 30 21:11:37.449460 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.449349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n" event={"ID":"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66","Type":"ContainerDied","Data":"0f580368bc76bd93f9731b88181b5ed56fd3754f63d485035d2c491252ae74fd"}
Jul 30 21:11:37.449460 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.449376    2583 scope.go:117] "RemoveContainer" containerID="10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"
Jul 30 21:11:37.459527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.459498    2583 scope.go:117] "RemoveContainer" containerID="10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"
Jul 30 21:11:37.459879 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:11:37.459851    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796\": container with ID starting with 10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796 not found: ID does not exist" containerID="10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"
Jul 30 21:11:37.459965 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.459892    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796"} err="failed to get container status \"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796\": rpc error: code = NotFound desc = could not find container \"10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796\": container with ID starting with 10a2289d657dae11f04e38c8dc89eb99f6503d71bb0fed3d28e1a21b287ef796 not found: ID does not exist"
Jul 30 21:11:37.574985 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.574938    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.574985 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.574986    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.575207 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575011    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.575207 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575073    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.575207 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575133    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r7dq\" (UniqueName: \"kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.575207 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575186    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache\") pod \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\" (UID: \"d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66\") "
Jul 30 21:11:37.575415 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575271    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home" (OuterVolumeSpecName: "home") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:37.575517 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575493    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache" (OuterVolumeSpecName: "model-cache") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:37.575582 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575508    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:37.575628 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.575583    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-home\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.577342 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.577321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm" (OuterVolumeSpecName: "dshm") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:11:37.577419 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.577345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:11:37.577460 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.577439    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq" (OuterVolumeSpecName: "kube-api-access-8r7dq") pod "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" (UID: "d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66"). InnerVolumeSpecName "kube-api-access-8r7dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:11:37.676802 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.676749    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r7dq\" (UniqueName: \"kubernetes.io/projected/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-kube-api-access-8r7dq\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.676802 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.676798    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-model-cache\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.676802 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.676807    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tls-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.676802 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.676815    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-dshm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.677085 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.676844    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66-tmp-dir\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:11:37.772528 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.772491    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:11:37.776007 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:37.775974    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e226df/auth-test-model-e226df-kserve-5dcbcbd699-jdg6n"]
Jul 30 21:11:38.753752 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:11:38.753716    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" path="/var/lib/kubelet/pods/d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66/volumes"
Jul 30 21:13:23.864056 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.864017    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:13:23.864541 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.864525    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" containerName="main"
Jul 30 21:13:23.864587 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.864543    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" containerName="main"
Jul 30 21:13:23.864645 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.864636    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4c1f38d-55b3-4cb9-bb97-b416bfeb3c66" containerName="main"
Jul 30 21:13:23.867794 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.867768    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.870527 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.870503    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-55df2b\"/\"kube-root-ca.crt\""
Jul 30 21:13:23.871862 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.871837    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-55df2b\"/\"openshift-service-ca.crt\""
Jul 30 21:13:23.872000 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.871837    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-55df2b\"/\"default-dockercfg-ht8pk\""
Jul 30 21:13:23.872000 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.871935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-55df2b\"/\"rate-test-model-55df2b-kserve-self-signed-certs\""
Jul 30 21:13:23.876786 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.876758    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:13:23.937666 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.937871 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937774    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrcl\" (UniqueName: \"kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.937871 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.937871 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.937979 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:23.937979 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:23.937924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039229 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrcl\" (UniqueName: \"kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039237    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039719    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039868 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039845    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.039929 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.039875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.041810 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.041788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.041969 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.041952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.050262 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.050232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrcl\" (UniqueName: \"kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl\") pod \"rate-test-model-55df2b-kserve-6cdb679859-fnglz\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") " pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.178717 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.178598    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:24.323167 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:24.323138    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:13:24.325150 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:13:24.325122    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5302dcd_5589_45ae_8366_b162fb46d321.slice/crio-8ef7186eac592fef5bc3f4dbae2f6a67e4cf7c1e97a22848b0f453a4fc403460 WatchSource:0}: Error finding container 8ef7186eac592fef5bc3f4dbae2f6a67e4cf7c1e97a22848b0f453a4fc403460: Status 404 returned error can't find the container with id 8ef7186eac592fef5bc3f4dbae2f6a67e4cf7c1e97a22848b0f453a4fc403460
Jul 30 21:13:25.021766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:25.021724    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" event={"ID":"a5302dcd-5589-45ae-8366-b162fb46d321","Type":"ContainerStarted","Data":"20b101bf2869f24f6e1a3515e58944c5b1362b75f052d747369c5089f13e3ec2"}
Jul 30 21:13:25.021766 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:25.021773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" event={"ID":"a5302dcd-5589-45ae-8366-b162fb46d321","Type":"ContainerStarted","Data":"8ef7186eac592fef5bc3f4dbae2f6a67e4cf7c1e97a22848b0f453a4fc403460"}
Jul 30 21:13:25.040412 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:25.040352    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" podStartSLOduration=2.040331847 podStartE2EDuration="2.040331847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:13:25.037726374 +0000 UTC m=+3132.800646901" watchObservedRunningTime="2026-07-30 21:13:25.040331847 +0000 UTC m=+3132.803252383"
Jul 30 21:13:34.179103 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:34.179069    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:34.179577 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:34.179115    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:34.192177 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:34.192146    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:13:35.088866 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:13:35.088829    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:15:27.527625 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:27.527592    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:15:42.547655 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.547589    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" podUID="a5302dcd-5589-45ae-8366-b162fb46d321" containerName="main" containerID="cri-o://20b101bf2869f24f6e1a3515e58944c5b1362b75f052d747369c5089f13e3ec2" gracePeriod=45
Jul 30 21:15:42.765992 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.765956    2583 generic.go:356] "Generic (PLEG): container finished" podID="a5302dcd-5589-45ae-8366-b162fb46d321" containerID="20b101bf2869f24f6e1a3515e58944c5b1362b75f052d747369c5089f13e3ec2" exitCode=0
Jul 30 21:15:42.766162 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.766045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" event={"ID":"a5302dcd-5589-45ae-8366-b162fb46d321","Type":"ContainerDied","Data":"20b101bf2869f24f6e1a3515e58944c5b1362b75f052d747369c5089f13e3ec2"}
Jul 30 21:15:42.811586 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.811521    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:15:42.961384 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961350    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961472    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961498    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzrcl\" (UniqueName: \"kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961572 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961547    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs\") pod \"a5302dcd-5589-45ae-8366-b162fb46d321\" (UID: \"a5302dcd-5589-45ae-8366-b162fb46d321\") "
Jul 30 21:15:42.961888 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961750    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:15:42.961888 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home" (OuterVolumeSpecName: "home") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:15:42.961888 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache" (OuterVolumeSpecName: "model-cache") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:15:42.962015 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961960    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-tmp-dir\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:42.962015 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961975    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-model-cache\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:42.962015 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.961985    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-home\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:42.963734 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.963702    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm" (OuterVolumeSpecName: "dshm") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:15:42.963870 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.963793    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:15:42.963918 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:42.963885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl" (OuterVolumeSpecName: "kube-api-access-mzrcl") pod "a5302dcd-5589-45ae-8366-b162fb46d321" (UID: "a5302dcd-5589-45ae-8366-b162fb46d321"). InnerVolumeSpecName "kube-api-access-mzrcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:15:43.063345 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.063252    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzrcl\" (UniqueName: \"kubernetes.io/projected/a5302dcd-5589-45ae-8366-b162fb46d321-kube-api-access-mzrcl\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:43.063345 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.063284    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5302dcd-5589-45ae-8366-b162fb46d321-tls-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:43.063345 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.063293    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5302dcd-5589-45ae-8366-b162fb46d321-dshm\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:15:43.772888 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.772849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz" event={"ID":"a5302dcd-5589-45ae-8366-b162fb46d321","Type":"ContainerDied","Data":"8ef7186eac592fef5bc3f4dbae2f6a67e4cf7c1e97a22848b0f453a4fc403460"}
Jul 30 21:15:43.772888 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.772874    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"
Jul 30 21:15:43.773430 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.772907    2583 scope.go:117] "RemoveContainer" containerID="20b101bf2869f24f6e1a3515e58944c5b1362b75f052d747369c5089f13e3ec2"
Jul 30 21:15:43.796071 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.796036    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:15:43.797944 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:43.797922    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-55df2b/rate-test-model-55df2b-kserve-6cdb679859-fnglz"]
Jul 30 21:15:44.754209 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:44.754172    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5302dcd-5589-45ae-8366-b162fb46d321" path="/var/lib/kubelet/pods/a5302dcd-5589-45ae-8366-b162fb46d321/volumes"
Jul 30 21:15:47.907701 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.907644    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:15:47.908278 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.908113    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5302dcd-5589-45ae-8366-b162fb46d321" containerName="main"
Jul 30 21:15:47.908278 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.908126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5302dcd-5589-45ae-8366-b162fb46d321" containerName="main"
Jul 30 21:15:47.908278 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.908221    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5302dcd-5589-45ae-8366-b162fb46d321" containerName="main"
Jul 30 21:15:47.913075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.913056    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:47.916351 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.916329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-720e63-openshift-default-dockercfg-wswnh\""
Jul 30 21:15:47.941110 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:47.941082    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:15:48.010497 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010654 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010654 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010654 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010561    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010654 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010596    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010816 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010675    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010816 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.010882 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.010850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7xt\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.111580 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.111776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.111776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.111776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7xt\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.111776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112016 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112016 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112016 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.111994    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112173 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112173 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112060    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112173 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112173 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112366 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.112519 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.112500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.114060 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.114036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.114525 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.114493    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.120539 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.120509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.120715 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.120675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7xt\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt\") pod \"e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") " pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.224121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.224030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:48.371893 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.371869    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:15:48.373667 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:15:48.373639    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9437ced4_a302_4241_824a_d18e8282c9c7.slice/crio-aadb3d91bbf1ef6abd50156b229e9bd02a70c6e9494b945e3dbff7e3f05e02d0 WatchSource:0}: Error finding container aadb3d91bbf1ef6abd50156b229e9bd02a70c6e9494b945e3dbff7e3f05e02d0: Status 404 returned error can't find the container with id aadb3d91bbf1ef6abd50156b229e9bd02a70c6e9494b945e3dbff7e3f05e02d0
Jul 30 21:15:48.376378 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.376348    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:15:48.376457 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.376419    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:15:48.376457 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.376448    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:15:48.802492 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.802458    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerStarted","Data":"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"}
Jul 30 21:15:48.802753 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.802523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerStarted","Data":"aadb3d91bbf1ef6abd50156b229e9bd02a70c6e9494b945e3dbff7e3f05e02d0"}
Jul 30 21:15:48.823251 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:48.823197    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podStartSLOduration=1.8231788070000001 podStartE2EDuration="1.823178807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:48.821872701 +0000 UTC m=+3276.584793259" watchObservedRunningTime="2026-07-30 21:15:48.823178807 +0000 UTC m=+3276.586099341"
Jul 30 21:15:49.225064 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:49.224972    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:49.230009 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:49.229982    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:49.808094 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:49.808066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:49.809099 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:49.809080    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:15:51.876392 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:51.876349    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:15:51.880215 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:51.880195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:51.883947 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:51.883926    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-720e63-serving-cert\""
Jul 30 21:15:51.891472 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:51.891443    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:15:52.061033 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.060976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.061033 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.061042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwxf8\" (UniqueName: \"kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.061275 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.061118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.162075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.161984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.162075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.162028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwxf8\" (UniqueName: \"kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.162075 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.162056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.162646 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.162624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.164589 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.164547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.171395 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.171372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwxf8\" (UniqueName: \"kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8\") pod \"maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.193279 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.193241    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:52.337895 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.337849    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:15:52.340134 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:15:52.340105    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807b9dc0_f833_41e0_9ad8_27a36d1a4f2c.slice/crio-7a49ae362fd90396a44c9e16dc1688c94d7318790f94be481130259a205fd1bf WatchSource:0}: Error finding container 7a49ae362fd90396a44c9e16dc1688c94d7318790f94be481130259a205fd1bf: Status 404 returned error can't find the container with id 7a49ae362fd90396a44c9e16dc1688c94d7318790f94be481130259a205fd1bf
Jul 30 21:15:52.341660 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.341644    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 21:15:52.825831 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:52.825789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" event={"ID":"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c","Type":"ContainerStarted","Data":"7a49ae362fd90396a44c9e16dc1688c94d7318790f94be481130259a205fd1bf"}
Jul 30 21:15:53.833173 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:53.833133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" event={"ID":"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c","Type":"ContainerStarted","Data":"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"}
Jul 30 21:15:53.833670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:53.833208    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:15:53.851337 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:53.851269    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" podStartSLOduration=2.3542855400000002 podStartE2EDuration="2.851251782s" totalImagesPullingTime="496.966242ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:15:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:15:53.851178844 +0000 UTC m=+3281.614099378" watchObservedRunningTime="2026-07-30 21:15:53.851251782 +0000 UTC m=+3281.614172316"
Jul 30 21:15:59.846546 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:15:59.846514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:16:05.090666 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.090150    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:49666->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Jul 30 21:16:05.090666 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.090219    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:49666->10.133.0.67:15021: read: connection reset by peer"
Jul 30 21:16:05.900106 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.900071    2583 generic.go:356] "Generic (PLEG): container finished" podID="9437ced4-a302-4241-824a-d18e8282c9c7" containerID="4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd" exitCode=0
Jul 30 21:16:05.900304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.900140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerDied","Data":"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"}
Jul 30 21:16:05.900584 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.900570    2583 scope.go:117] "RemoveContainer" containerID="4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"
Jul 30 21:16:05.901722 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.901669    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:16:05.901788 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.901773    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:16:05.901835 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:05.901813    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 21:16:06.907915 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:06.907876    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerStarted","Data":"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"}
Jul 30 21:16:07.225017 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:07.224919    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:16:07.225253 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:07.225211    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 21:16:07.225354 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:07.225290    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 21:16:08.224554 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:08.224504    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 21:16:08.225104 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:08.224582    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 21:16:09.232254 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:09.232210    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 21:16:09.232897 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:09.232858    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 21:16:10.224923 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:10.224881    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 21:16:10.225154 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:10.224959    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 21:16:11.225309 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:11.225265    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 30 21:16:11.226364 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:11.225928    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 30 21:16:12.229436 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:12.229400    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:16:12.229855 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:12.229798    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:16:12.230553 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:12.230536    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:16:21.104260 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.104219    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:16:21.108243 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.108216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.111335 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.111311    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-6967f3-serving-cert\""
Jul 30 21:16:21.121067 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.121037    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:16:21.267942 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.267898    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.267942 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.267938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2bk2\" (UniqueName: \"kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.268166 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.268005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.369523 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.369424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.369755 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.369581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.369755 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.369611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2bk2\" (UniqueName: \"kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.370268 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.370247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.371910 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.371892    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.378576 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.378556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2bk2\" (UniqueName: \"kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2\") pod \"maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.419724 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.419672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:21.563726 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:21.563673    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:16:21.565980 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:16:21.565952    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416ef24f_2b28_47bb_a71a_91020a8c47b5.slice/crio-989174323af34ec24b8019addde838e36000bb91112007e0192f083707d46fd2 WatchSource:0}: Error finding container 989174323af34ec24b8019addde838e36000bb91112007e0192f083707d46fd2: Status 404 returned error can't find the container with id 989174323af34ec24b8019addde838e36000bb91112007e0192f083707d46fd2
Jul 30 21:16:22.007098 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:22.007061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" event={"ID":"416ef24f-2b28-47bb-a71a-91020a8c47b5","Type":"ContainerStarted","Data":"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"}
Jul 30 21:16:22.007266 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:22.007116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" event={"ID":"416ef24f-2b28-47bb-a71a-91020a8c47b5","Type":"ContainerStarted","Data":"989174323af34ec24b8019addde838e36000bb91112007e0192f083707d46fd2"}
Jul 30 21:16:22.007266 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:22.007139    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:16:22.026478 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:22.026426    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" podStartSLOduration=0.680191796 podStartE2EDuration="1.026409924s" totalImagesPullingTime="346.218128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:16:22.024071588 +0000 UTC m=+3309.786992123" watchObservedRunningTime="2026-07-30 21:16:22.026409924 +0000 UTC m=+3309.789330458"
Jul 30 21:16:28.019329 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:16:28.019300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:17:46.582697 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.582647    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:17:46.586559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.586540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.589473 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.589452    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-e026c1-serving-cert\""
Jul 30 21:17:46.611210 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.611181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:17:46.630656 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.630617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.630873 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.630678    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdfn\" (UniqueName: \"kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.630873 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.630763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.731960 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.731925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.732151 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.731980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdfn\" (UniqueName: \"kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.732151 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.732025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.732279 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:17:46.732197    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-serving-cert: secret "maas-api-e2e-ipp-cleanup-e026c1-serving-cert" not found
Jul 30 21:17:46.732279 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:17:46.732262    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls podName:3b6d462d-8680-4e9f-a09e-fc4d7f728fa0 nodeName:}" failed. No retries permitted until 2026-07-30 21:17:47.232242301 +0000 UTC m=+3394.995162813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" (UID: "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0") : secret "maas-api-e2e-ipp-cleanup-e026c1-serving-cert" not found
Jul 30 21:17:46.732631 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.732609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:46.743712 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:46.743648    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdfn\" (UniqueName: \"kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:47.238114 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:47.238075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:47.240609 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:47.240577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:47.496761 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:47.496655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:47.640852 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:47.640827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:17:47.643296 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:17:47.643266    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6d462d_8680_4e9f_a09e_fc4d7f728fa0.slice/crio-017154bea0bba10ca04f5a839f150918964e4ab00885d796a29b8c487a7ca818 WatchSource:0}: Error finding container 017154bea0bba10ca04f5a839f150918964e4ab00885d796a29b8c487a7ca818: Status 404 returned error can't find the container with id 017154bea0bba10ca04f5a839f150918964e4ab00885d796a29b8c487a7ca818
Jul 30 21:17:48.470504 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:48.470470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" event={"ID":"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0","Type":"ContainerStarted","Data":"017154bea0bba10ca04f5a839f150918964e4ab00885d796a29b8c487a7ca818"}
Jul 30 21:17:49.477765 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:49.477723    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" event={"ID":"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0","Type":"ContainerStarted","Data":"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"}
Jul 30 21:17:49.478168 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:49.477792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:17:49.495648 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:49.495591    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" podStartSLOduration=2.187741498 podStartE2EDuration="3.495573956s" totalImagesPullingTime="1.307832458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:17:49.494473154 +0000 UTC m=+3397.257393690" watchObservedRunningTime="2026-07-30 21:17:49.495573956 +0000 UTC m=+3397.258494489"
Jul 30 21:17:55.488770 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:17:55.488739    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:18:17.295049 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.295014    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:18:17.295503 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.295242    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" podUID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" containerName="maas-api" containerID="cri-o://c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a" gracePeriod=30
Jul 30 21:18:17.565717 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.565673    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:18:17.635121 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.635084    2583 generic.go:356] "Generic (PLEG): container finished" podID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" containerID="c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a" exitCode=0
Jul 30 21:18:17.635296 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.635129    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"
Jul 30 21:18:17.635296 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.635162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" event={"ID":"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0","Type":"ContainerDied","Data":"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"}
Jul 30 21:18:17.635296 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.635222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z" event={"ID":"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0","Type":"ContainerDied","Data":"017154bea0bba10ca04f5a839f150918964e4ab00885d796a29b8c487a7ca818"}
Jul 30 21:18:17.635296 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.635246    2583 scope.go:117] "RemoveContainer" containerID="c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"
Jul 30 21:18:17.644343 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644324    2583 scope.go:117] "RemoveContainer" containerID="c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"
Jul 30 21:18:17.644528 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644504    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvdfn\" (UniqueName: \"kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn\") pod \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") "
Jul 30 21:18:17.644642 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca\") pod \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") "
Jul 30 21:18:17.644642 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:18:17.644615    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a\": container with ID starting with c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a not found: ID does not exist" containerID="c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"
Jul 30 21:18:17.644759 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644642    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a"} err="failed to get container status \"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a\": rpc error: code = NotFound desc = could not find container \"c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a\": container with ID starting with c35709267bd61c7032474dc451e1a1b37ed9e9e3a3d5531a64154c6a0498c29a not found: ID does not exist"
Jul 30 21:18:17.644759 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644671    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") pod \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\" (UID: \"3b6d462d-8680-4e9f-a09e-fc4d7f728fa0\") "
Jul 30 21:18:17.645139 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.644901    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" (UID: "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:18:17.645139 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.645066    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:17.646665 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.646638    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn" (OuterVolumeSpecName: "kube-api-access-kvdfn") pod "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" (UID: "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0"). InnerVolumeSpecName "kube-api-access-kvdfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:18:17.646665 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.646658    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" (UID: "3b6d462d-8680-4e9f-a09e-fc4d7f728fa0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:18:17.746150 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.746105    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvdfn\" (UniqueName: \"kubernetes.io/projected/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-kube-api-access-kvdfn\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:17.746150 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.746142    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:17.957367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.957338    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:18:17.962907 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:17.962880    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e026c1-5856ff65f-xl24z"]
Jul 30 21:18:18.754914 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:18.754880    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" path="/var/lib/kubelet/pods/3b6d462d-8680-4e9f-a09e-fc4d7f728fa0/volumes"
Jul 30 21:18:43.222379 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.222344    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:18:43.222919 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.222565    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" podUID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" containerName="maas-api" containerID="cri-o://4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5" gracePeriod=30
Jul 30 21:18:43.489336 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.489307    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:18:43.505959 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.505930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls\") pod \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") "
Jul 30 21:18:43.506150 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.505985    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca\") pod \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") "
Jul 30 21:18:43.506150 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.506110    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwxf8\" (UniqueName: \"kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8\") pod \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\" (UID: \"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c\") "
Jul 30 21:18:43.506394 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.506363    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" (UID: "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:18:43.508192 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.508167    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" (UID: "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:18:43.508288 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.508238    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8" (OuterVolumeSpecName: "kube-api-access-jwxf8") pod "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" (UID: "807b9dc0-f833-41e0-9ad8-27a36d1a4f2c"). InnerVolumeSpecName "kube-api-access-jwxf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:18:43.607863 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.607818    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwxf8\" (UniqueName: \"kubernetes.io/projected/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-kube-api-access-jwxf8\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:43.607863 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.607854    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:43.607863 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.607866    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:18:43.780488 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.780396    2583 generic.go:356] "Generic (PLEG): container finished" podID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" containerID="4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5" exitCode=0
Jul 30 21:18:43.780488 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.780440    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"
Jul 30 21:18:43.780682 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.780477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" event={"ID":"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c","Type":"ContainerDied","Data":"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"}
Jul 30 21:18:43.780682 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.780538    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf" event={"ID":"807b9dc0-f833-41e0-9ad8-27a36d1a4f2c","Type":"ContainerDied","Data":"7a49ae362fd90396a44c9e16dc1688c94d7318790f94be481130259a205fd1bf"}
Jul 30 21:18:43.780682 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.780561    2583 scope.go:117] "RemoveContainer" containerID="4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"
Jul 30 21:18:43.790879 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.790861    2583 scope.go:117] "RemoveContainer" containerID="4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"
Jul 30 21:18:43.791175 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:18:43.791153    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5\": container with ID starting with 4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5 not found: ID does not exist" containerID="4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"
Jul 30 21:18:43.791232 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.791198    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5"} err="failed to get container status \"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5\": rpc error: code = NotFound desc = could not find container \"4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5\": container with ID starting with 4ba32bd50ed6fb90ecc2b9830b17a4cde1150698696d98a66bf8c15a11f65ba5 not found: ID does not exist"
Jul 30 21:18:43.803548 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.803523    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:18:43.807666 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:43.807640    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-720e63-64bd755798-tc4cf"]
Jul 30 21:18:44.754367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:18:44.754332    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" path="/var/lib/kubelet/pods/807b9dc0-f833-41e0-9ad8-27a36d1a4f2c/volumes"
Jul 30 21:19:37.564304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:37.564224    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:19:37.564771 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:37.564440    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" containerID="cri-o://74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6" gracePeriod=30
Jul 30 21:19:42.232928 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.232891    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 30 21:19:42.233333 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.232961    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 30 21:19:42.814839 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.814813    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:19:42.902344 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902252    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902344 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902344 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902314    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902443    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rk7xt\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902535    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902558    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:19:42.902633 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs\") pod \"9437ced4-a302-4241-824a-d18e8282c9c7\" (UID: \"9437ced4-a302-4241-824a-d18e8282c9c7\") "
Jul 30 21:19:42.903024 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902832    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:19:42.903024 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902938    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:19:42.903024 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.902976    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:19:42.903251 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.903231    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:19:42.903324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.903235    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9437ced4-a302-4241-824a-d18e8282c9c7-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:42.903324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.903281    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:42.903324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.903300    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:42.903324 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.903314    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:42.904592 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.904565    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:19:42.904592 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.904565    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:19:42.904786 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.904670    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt" (OuterVolumeSpecName: "kube-api-access-rk7xt") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "kube-api-access-rk7xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:19:42.905167 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:42.905144    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9437ced4-a302-4241-824a-d18e8282c9c7" (UID: "9437ced4-a302-4241-824a-d18e8282c9c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:19:43.003897 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.003862    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:43.003897 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.003893    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9437ced4-a302-4241-824a-d18e8282c9c7-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:43.003897 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.003902    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:43.004123 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.003912    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9437ced4-a302-4241-824a-d18e8282c9c7-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:43.004123 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.003921    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rk7xt\" (UniqueName: \"kubernetes.io/projected/9437ced4-a302-4241-824a-d18e8282c9c7-kube-api-access-rk7xt\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:43.114891 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.114856    2583 generic.go:356] "Generic (PLEG): container finished" podID="9437ced4-a302-4241-824a-d18e8282c9c7" containerID="74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6" exitCode=0
Jul 30 21:19:43.115061 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.114916    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"
Jul 30 21:19:43.115061 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.114937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerDied","Data":"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"}
Jul 30 21:19:43.115061 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.115000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m" event={"ID":"9437ced4-a302-4241-824a-d18e8282c9c7","Type":"ContainerDied","Data":"aadb3d91bbf1ef6abd50156b229e9bd02a70c6e9494b945e3dbff7e3f05e02d0"}
Jul 30 21:19:43.115061 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.115033    2583 scope.go:117] "RemoveContainer" containerID="74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"
Jul 30 21:19:43.124953 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.124936    2583 scope.go:117] "RemoveContainer" containerID="4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"
Jul 30 21:19:43.135771 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.135751    2583 scope.go:117] "RemoveContainer" containerID="74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"
Jul 30 21:19:43.136062 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:19:43.136040    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6\": container with ID starting with 74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6 not found: ID does not exist" containerID="74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"
Jul 30 21:19:43.136113 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.136071    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6"} err="failed to get container status \"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6\": rpc error: code = NotFound desc = could not find container \"74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6\": container with ID starting with 74e561a0c373203a432a05e4e889ad703c2bf730760b5fa9b394243ffa9334d6 not found: ID does not exist"
Jul 30 21:19:43.136113 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.136089    2583 scope.go:117] "RemoveContainer" containerID="4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"
Jul 30 21:19:43.136340 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:19:43.136320    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd\": container with ID starting with 4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd not found: ID does not exist" containerID="4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"
Jul 30 21:19:43.136382 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.136346    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd"} err="failed to get container status \"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd\": rpc error: code = NotFound desc = could not find container \"4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd\": container with ID starting with 4eb7b57259cabfb963b1ddc645ac66d0180ed30ea2ef60581606029798e285dd not found: ID does not exist"
Jul 30 21:19:43.139468 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.139444    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:19:43.145581 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:43.145558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-720e63-openshift-default-7d9d7f7576-std9m"]
Jul 30 21:19:44.755092 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:44.755059    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" path="/var/lib/kubelet/pods/9437ced4-a302-4241-824a-d18e8282c9c7/volumes"
Jul 30 21:19:48.483184 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.483142    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:19:48.483596 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.483375    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" podUID="416ef24f-2b28-47bb-a71a-91020a8c47b5" containerName="maas-api" containerID="cri-o://f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537" gracePeriod=30
Jul 30 21:19:48.744622 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.744554    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:19:48.871532 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.871489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca\") pod \"416ef24f-2b28-47bb-a71a-91020a8c47b5\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") "
Jul 30 21:19:48.871735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.871566    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls\") pod \"416ef24f-2b28-47bb-a71a-91020a8c47b5\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") "
Jul 30 21:19:48.871735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.871651    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2bk2\" (UniqueName: \"kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2\") pod \"416ef24f-2b28-47bb-a71a-91020a8c47b5\" (UID: \"416ef24f-2b28-47bb-a71a-91020a8c47b5\") "
Jul 30 21:19:48.872043 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.871929    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "416ef24f-2b28-47bb-a71a-91020a8c47b5" (UID: "416ef24f-2b28-47bb-a71a-91020a8c47b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:19:48.872331 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.872081    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/416ef24f-2b28-47bb-a71a-91020a8c47b5-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:48.873843 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.873814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "416ef24f-2b28-47bb-a71a-91020a8c47b5" (UID: "416ef24f-2b28-47bb-a71a-91020a8c47b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:19:48.874211 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.874186    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2" (OuterVolumeSpecName: "kube-api-access-k2bk2") pod "416ef24f-2b28-47bb-a71a-91020a8c47b5" (UID: "416ef24f-2b28-47bb-a71a-91020a8c47b5"). InnerVolumeSpecName "kube-api-access-k2bk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:19:48.972932 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.972878    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/416ef24f-2b28-47bb-a71a-91020a8c47b5-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:48.972932 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:48.972923    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2bk2\" (UniqueName: \"kubernetes.io/projected/416ef24f-2b28-47bb-a71a-91020a8c47b5-kube-api-access-k2bk2\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:19:49.149962 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.149869    2583 generic.go:356] "Generic (PLEG): container finished" podID="416ef24f-2b28-47bb-a71a-91020a8c47b5" containerID="f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537" exitCode=0
Jul 30 21:19:49.149962 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.149912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"
Jul 30 21:19:49.150171 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.149956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" event={"ID":"416ef24f-2b28-47bb-a71a-91020a8c47b5","Type":"ContainerDied","Data":"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"}
Jul 30 21:19:49.150171 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.150009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26" event={"ID":"416ef24f-2b28-47bb-a71a-91020a8c47b5","Type":"ContainerDied","Data":"989174323af34ec24b8019addde838e36000bb91112007e0192f083707d46fd2"}
Jul 30 21:19:49.150171 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.150032    2583 scope.go:117] "RemoveContainer" containerID="f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"
Jul 30 21:19:49.159992 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.159974    2583 scope.go:117] "RemoveContainer" containerID="f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"
Jul 30 21:19:49.160330 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:19:49.160298    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537\": container with ID starting with f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537 not found: ID does not exist" containerID="f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"
Jul 30 21:19:49.160381 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.160329    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537"} err="failed to get container status \"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537\": rpc error: code = NotFound desc = could not find container \"f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537\": container with ID starting with f9fcabbd8e1bdb7d18d2725797110a518f48331ede48debc83020ecc4b3bc537 not found: ID does not exist"
Jul 30 21:19:49.172854 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.172820    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:19:49.177640 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:49.177612    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-6967f3-778fd9f98f-shk26"]
Jul 30 21:19:50.754467 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:19:50.754424    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416ef24f-2b28-47bb-a71a-91020a8c47b5" path="/var/lib/kubelet/pods/416ef24f-2b28-47bb-a71a-91020a8c47b5/volumes"
Jul 30 21:20:05.912520 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:05.912481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:20:05.912975 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:05.912767    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" podUID="5d5118b4-c1e0-4114-ab50-b573154228f1" containerName="maas-api" containerID="cri-o://fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0" gracePeriod=30
Jul 30 21:20:06.164600 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.164540    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:20:06.240364 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.240327    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d5118b4-c1e0-4114-ab50-b573154228f1" containerID="fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0" exitCode=0
Jul 30 21:20:06.240559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.240371    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"
Jul 30 21:20:06.240559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.240419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" event={"ID":"5d5118b4-c1e0-4114-ab50-b573154228f1","Type":"ContainerDied","Data":"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"}
Jul 30 21:20:06.240559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.240477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn" event={"ID":"5d5118b4-c1e0-4114-ab50-b573154228f1","Type":"ContainerDied","Data":"bb9324b45a88318d1b38bde5d2a0bbe323a3234b980e16b64af1ecb473eb52dd"}
Jul 30 21:20:06.240559 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.240507    2583 scope.go:117] "RemoveContainer" containerID="fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"
Jul 30 21:20:06.250990 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.250897    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") pod \"5d5118b4-c1e0-4114-ab50-b573154228f1\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") "
Jul 30 21:20:06.250990 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.250945    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca\") pod \"5d5118b4-c1e0-4114-ab50-b573154228f1\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") "
Jul 30 21:20:06.251179 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.251023    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knzvp\" (UniqueName: \"kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp\") pod \"5d5118b4-c1e0-4114-ab50-b573154228f1\" (UID: \"5d5118b4-c1e0-4114-ab50-b573154228f1\") "
Jul 30 21:20:06.251430 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.251399    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d5118b4-c1e0-4114-ab50-b573154228f1" (UID: "5d5118b4-c1e0-4114-ab50-b573154228f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:20:06.251856 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.251834    2583 scope.go:117] "RemoveContainer" containerID="fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"
Jul 30 21:20:06.252184 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:06.252162    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0\": container with ID starting with fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0 not found: ID does not exist" containerID="fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"
Jul 30 21:20:06.252287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.252194    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0"} err="failed to get container status \"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0\": rpc error: code = NotFound desc = could not find container \"fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0\": container with ID starting with fa2cbf3c17ce7524a28378678af55b3cb1b1b3ed255821d29b90cbbeeabea2f0 not found: ID does not exist"
Jul 30 21:20:06.253192 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.253163    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp" (OuterVolumeSpecName: "kube-api-access-knzvp") pod "5d5118b4-c1e0-4114-ab50-b573154228f1" (UID: "5d5118b4-c1e0-4114-ab50-b573154228f1"). InnerVolumeSpecName "kube-api-access-knzvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:06.253281 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.253239    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d5118b4-c1e0-4114-ab50-b573154228f1" (UID: "5d5118b4-c1e0-4114-ab50-b573154228f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:20:06.352282 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.352247    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knzvp\" (UniqueName: \"kubernetes.io/projected/5d5118b4-c1e0-4114-ab50-b573154228f1-kube-api-access-knzvp\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:06.352282 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.352278    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d5118b4-c1e0-4114-ab50-b573154228f1-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:06.352282 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.352287    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d5118b4-c1e0-4114-ab50-b573154228f1-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:06.569322 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.569285    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:20:06.571147 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.571121    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-55df2b-7d45fdc975-zhncn"]
Jul 30 21:20:06.754226 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:06.754193    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d5118b4-c1e0-4114-ab50-b573154228f1" path="/var/lib/kubelet/pods/5d5118b4-c1e0-4114-ab50-b573154228f1/volumes"
Jul 30 21:20:12.867256 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:12.867211    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:20:12.867650 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:12.867473    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy" containerID="cri-o://4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d" gracePeriod=30
Jul 30 21:20:18.132378 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.132344    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:20:18.273059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273016    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pw7m\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273059 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273063    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273349 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273134    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273349 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273198    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273349 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273253    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273349 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273316    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273349 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273341    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273601 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273368    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273601 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs\") pod \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\" (UID: \"ce7788ea-ce11-4732-b85f-3a6cb63e7134\") "
Jul 30 21:20:18.273601 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:18.273601 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273586    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:18.273830 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273726    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:20:18.273936 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273912    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:18.273999 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273931    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.273999 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273955    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.273999 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.273969    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.274161 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.274087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:18.275482 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.275451    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:20:18.275482 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.275468    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m" (OuterVolumeSpecName: "kube-api-access-4pw7m") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "kube-api-access-4pw7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:18.275629 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.275498    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:18.275629 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.275530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce7788ea-ce11-4732-b85f-3a6cb63e7134" (UID: "ce7788ea-ce11-4732-b85f-3a6cb63e7134"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:18.307225 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.307194    2583 generic.go:356] "Generic (PLEG): container finished" podID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerID="4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d" exitCode=0
Jul 30 21:20:18.307410 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.307239    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"
Jul 30 21:20:18.307410 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.307275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerDied","Data":"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"}
Jul 30 21:20:18.307410 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.307344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8" event={"ID":"ce7788ea-ce11-4732-b85f-3a6cb63e7134","Type":"ContainerDied","Data":"ba3c0d4fa0dd666e7e3a4a0dfadfe7dd99afd3607cf9c04147fa2076a7907946"}
Jul 30 21:20:18.307410 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.307376    2583 scope.go:117] "RemoveContainer" containerID="4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"
Jul 30 21:20:18.317277 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.317259    2583 scope.go:117] "RemoveContainer" containerID="dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"
Jul 30 21:20:18.325591 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.325572    2583 scope.go:117] "RemoveContainer" containerID="4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"
Jul 30 21:20:18.325926 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:18.325905    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d\": container with ID starting with 4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d not found: ID does not exist" containerID="4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"
Jul 30 21:20:18.326026 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.325932    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d"} err="failed to get container status \"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d\": rpc error: code = NotFound desc = could not find container \"4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d\": container with ID starting with 4b6ad73165611e61d0f140248b9dd21c52b8dfab883fd745cf16db8b1cbd1c9d not found: ID does not exist"
Jul 30 21:20:18.326026 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.325950    2583 scope.go:117] "RemoveContainer" containerID="dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"
Jul 30 21:20:18.326212 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:18.326196    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f\": container with ID starting with dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f not found: ID does not exist" containerID="dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"
Jul 30 21:20:18.326258 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.326216    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f"} err="failed to get container status \"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f\": rpc error: code = NotFound desc = could not find container \"dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f\": container with ID starting with dcc4f80d919c2b0f01808bf3405fd0a60a193da3327528350afb6f715da4497f not found: ID does not exist"
Jul 30 21:20:18.330210 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.330185    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:20:18.334485 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.334459    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-55df2b-openshift-default-576c8cbbf6-ptlt8"]
Jul 30 21:20:18.375367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375331    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.375367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375360    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.375367 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375370    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.375562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375380    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce7788ea-ce11-4732-b85f-3a6cb63e7134-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.375562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375389    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pw7m\" (UniqueName: \"kubernetes.io/projected/ce7788ea-ce11-4732-b85f-3a6cb63e7134-kube-api-access-4pw7m\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.375562 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.375397    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce7788ea-ce11-4732-b85f-3a6cb63e7134-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:18.753921 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:18.753886    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" path="/var/lib/kubelet/pods/ce7788ea-ce11-4732-b85f-3a6cb63e7134/volumes"
Jul 30 21:20:23.795772 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:23.795729    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:20:23.796262 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:23.795996    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerName="maas-api" containerID="cri-o://35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb" gracePeriod=30
Jul 30 21:20:23.839017 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:23.838967    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.64:8443/health\": dial tcp 10.133.0.64:8443: connect: connection refused"
Jul 30 21:20:24.054528 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.054451    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:20:24.232165 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.232130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls\") pod \"e290c246-cd67-4ab6-aab6-f6e136e7001e\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") "
Jul 30 21:20:24.232376 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.232192    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzf49\" (UniqueName: \"kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49\") pod \"e290c246-cd67-4ab6-aab6-f6e136e7001e\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") "
Jul 30 21:20:24.232452 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.232379    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca\") pod \"e290c246-cd67-4ab6-aab6-f6e136e7001e\" (UID: \"e290c246-cd67-4ab6-aab6-f6e136e7001e\") "
Jul 30 21:20:24.232701 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.232670    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e290c246-cd67-4ab6-aab6-f6e136e7001e" (UID: "e290c246-cd67-4ab6-aab6-f6e136e7001e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:20:24.234304 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.234282    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e290c246-cd67-4ab6-aab6-f6e136e7001e" (UID: "e290c246-cd67-4ab6-aab6-f6e136e7001e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 21:20:24.234409 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.234392    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49" (OuterVolumeSpecName: "kube-api-access-vzf49") pod "e290c246-cd67-4ab6-aab6-f6e136e7001e" (UID: "e290c246-cd67-4ab6-aab6-f6e136e7001e"). InnerVolumeSpecName "kube-api-access-vzf49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:24.333672 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.333567    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzf49\" (UniqueName: \"kubernetes.io/projected/e290c246-cd67-4ab6-aab6-f6e136e7001e-kube-api-access-vzf49\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:24.333672 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.333614    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e290c246-cd67-4ab6-aab6-f6e136e7001e-openshift-service-ca\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:24.333672 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.333625    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e290c246-cd67-4ab6-aab6-f6e136e7001e-maas-api-tls\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:24.341928 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.341897    2583 generic.go:356] "Generic (PLEG): container finished" podID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerID="35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb" exitCode=0
Jul 30 21:20:24.342108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.341949    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"
Jul 30 21:20:24.342108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.341984    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" event={"ID":"e290c246-cd67-4ab6-aab6-f6e136e7001e","Type":"ContainerDied","Data":"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"}
Jul 30 21:20:24.342108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.342050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz" event={"ID":"e290c246-cd67-4ab6-aab6-f6e136e7001e","Type":"ContainerDied","Data":"a03e84dd5e6b4d7a798bd0ecb6c17de88ea6f1d4db5eef2074e99bbb7dfd6bf3"}
Jul 30 21:20:24.342108 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.342079    2583 scope.go:117] "RemoveContainer" containerID="35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"
Jul 30 21:20:24.354403 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.354328    2583 scope.go:117] "RemoveContainer" containerID="35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"
Jul 30 21:20:24.355111 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:24.355080    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb\": container with ID starting with 35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb not found: ID does not exist" containerID="35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"
Jul 30 21:20:24.355218 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.355117    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb"} err="failed to get container status \"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb\": rpc error: code = NotFound desc = could not find container \"35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb\": container with ID starting with 35ffa26557b27dcd597e8858e8fa80af8ec648fd817185e0f718bc9977f738cb not found: ID does not exist"
Jul 30 21:20:24.364608 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.364576    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:20:24.371135 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.371099    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e226df-6f889487df-lsmrz"]
Jul 30 21:20:24.755007 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:24.754967    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" path="/var/lib/kubelet/pods/e290c246-cd67-4ab6-aab6-f6e136e7001e/volumes"
Jul 30 21:20:30.402933 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:30.402894    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:20:30.403356 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:30.403194    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy" containerID="cri-o://04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2" gracePeriod=30
Jul 30 21:20:31.105671 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:31.105618    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fcb895fc-gdh7k_c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe/authorino/0.log"
Jul 30 21:20:35.666267 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.666242    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:20:35.741758 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741682    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.741939 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741774    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.741939 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741799    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.741939 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741820    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.741939 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741850    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzg85\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.742188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741947    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.742188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.741964    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.742188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742006    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.742188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token\") pod \"a62a8323-6948-4236-b42c-291a2636a496\" (UID: \"a62a8323-6948-4236-b42c-291a2636a496\") "
Jul 30 21:20:35.742188 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742224    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742374    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742434    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-credential-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742429    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data" (OuterVolumeSpecName: "istio-data") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:35.742458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.742448    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a62a8323-6948-4236-b42c-291a2636a496-istiod-ca-cert\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.744208 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.744172    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 21:20:35.744208 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.744197    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token" (OuterVolumeSpecName: "istio-token") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:35.744397 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.744246    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 21:20:35.744397 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.744260    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85" (OuterVolumeSpecName: "kube-api-access-zzg85") pod "a62a8323-6948-4236-b42c-291a2636a496" (UID: "a62a8323-6948-4236-b42c-291a2636a496"). InnerVolumeSpecName "kube-api-access-zzg85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 21:20:35.843328 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843292    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-certs\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843328 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843321    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-workload-socket\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843328 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843331    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-istio-token\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843651 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843341    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a62a8323-6948-4236-b42c-291a2636a496-istio-podinfo\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843651 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843351    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-data\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843651 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843359    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzg85\" (UniqueName: \"kubernetes.io/projected/a62a8323-6948-4236-b42c-291a2636a496-kube-api-access-zzg85\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:35.843651 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:35.843369    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a62a8323-6948-4236-b42c-291a2636a496-istio-envoy\") on node \"ip-10-0-142-180.ec2.internal\" DevicePath \"\""
Jul 30 21:20:36.406448 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.406409    2583 generic.go:356] "Generic (PLEG): container finished" podID="a62a8323-6948-4236-b42c-291a2636a496" containerID="04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2" exitCode=0
Jul 30 21:20:36.406448 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.406450    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"
Jul 30 21:20:36.406670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.406492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerDied","Data":"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"}
Jul 30 21:20:36.406670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.406550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9" event={"ID":"a62a8323-6948-4236-b42c-291a2636a496","Type":"ContainerDied","Data":"342e8e119a8cabbd6eed5a1b2edd5670e0ab8c5d62156061023f90af3e468b8b"}
Jul 30 21:20:36.406670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.406576    2583 scope.go:117] "RemoveContainer" containerID="04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"
Jul 30 21:20:36.415879 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.415851    2583 scope.go:117] "RemoveContainer" containerID="d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"
Jul 30 21:20:36.424903 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.424882    2583 scope.go:117] "RemoveContainer" containerID="04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"
Jul 30 21:20:36.425198 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:36.425178    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2\": container with ID starting with 04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2 not found: ID does not exist" containerID="04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"
Jul 30 21:20:36.425287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.425207    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2"} err="failed to get container status \"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2\": rpc error: code = NotFound desc = could not find container \"04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2\": container with ID starting with 04ad34d1af9d6556cb7b0227091a4f2c0e7d8b1e9304a547d53fbddee7003fb2 not found: ID does not exist"
Jul 30 21:20:36.425287 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.425235    2583 scope.go:117] "RemoveContainer" containerID="d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"
Jul 30 21:20:36.425507 ip-10-0-142-180 kubenswrapper[2583]: E0730 21:20:36.425488    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41\": container with ID starting with d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41 not found: ID does not exist" containerID="d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"
Jul 30 21:20:36.425544 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.425515    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41"} err="failed to get container status \"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41\": rpc error: code = NotFound desc = could not find container \"d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41\": container with ID starting with d9e16a90606b83a65923429f6b400d4ec50ea25acd6efe787e69f706353b3e41 not found: ID does not exist"
Jul 30 21:20:36.430305 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.430274    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:20:36.434885 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.434856    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e226df-openshift-default-766d7974b8-6qwq9"]
Jul 30 21:20:36.753776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:36.753743    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a62a8323-6948-4236-b42c-291a2636a496" path="/var/lib/kubelet/pods/a62a8323-6948-4236-b42c-291a2636a496/volumes"
Jul 30 21:20:37.444310 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:37.444285    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fb4f68b-sf8qp_e08c92d4-dcd4-4597-a979-5e0e94f4da5c/copy-manifests/0.log"
Jul 30 21:20:37.452190 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:37.452163    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fb4f68b-sf8qp_e08c92d4-dcd4-4597-a979-5e0e94f4da5c/manager/0.log"
Jul 30 21:20:37.804682 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:37.804650    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7cf66f64b9-m9npl_e98b4a90-d467-400f-8fcd-96c1c391752b/maas-api/0.log"
Jul 30 21:20:37.927575 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:37.927546    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757405-fpc9n_f2ddf181-a0b4-49e6-bb8c-ddf0cd230bc0/cleanup/0.log"
Jul 30 21:20:39.065753 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:39.065719    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fcb895fc-gdh7k_c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe/authorino/0.log"
Jul 30 21:20:39.184726 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:39.184694    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-msk29_5afb0569-cec5-4bef-8076-2686be32ed44/manager/0.log"
Jul 30 21:20:40.481735 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:40.481680    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c4ff7d78-gj8cm_b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab/kube-auth-proxy/0.log"
Jul 30 21:20:41.341207 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:41.341178    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kt2ch_9f8ec850-2e6f-4621-9e8a-2beb343ee0fa/main/0.log"
Jul 30 21:20:47.806145 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806101    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dkmk7/must-gather-xdrsm"]
Jul 30 21:20:47.806666 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806649    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806668    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806681    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416ef24f-2b28-47bb-a71a-91020a8c47b5" containerName="maas-api"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806708    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="416ef24f-2b28-47bb-a71a-91020a8c47b5" containerName="maas-api"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806719    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806726    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806737    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806742    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806748    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806753    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.806757 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806762    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d5118b4-c1e0-4114-ab50-b573154228f1" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806766    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d5118b4-c1e0-4114-ab50-b573154228f1" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806788    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806796    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806806    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806812    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806820    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806825    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806890    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="807b9dc0-f833-41e0-9ad8-27a36d1a4f2c" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806899    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d5118b4-c1e0-4114-ab50-b573154228f1" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806905    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806910    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806916    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="416ef24f-2b28-47bb-a71a-91020a8c47b5" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806924    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806929    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6d462d-8680-4e9f-a09e-fc4d7f728fa0" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806935    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806940    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e290c246-cd67-4ab6-aab6-f6e136e7001e" containerName="maas-api"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.806946    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.807011    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.807016    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce7788ea-ce11-4732-b85f-3a6cb63e7134" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.807027    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.807032    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a62a8323-6948-4236-b42c-291a2636a496" containerName="istio-proxy"
Jul 30 21:20:47.807080 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.807084    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9437ced4-a302-4241-824a-d18e8282c9c7" containerName="istio-proxy"
Jul 30 21:20:47.811582 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.811563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:47.814099 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.814081    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkmk7\"/\"openshift-service-ca.crt\""
Jul 30 21:20:47.815624 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.815597    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dkmk7\"/\"default-dockercfg-xzmq2\""
Jul 30 21:20:47.815906 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.815863    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dkmk7\"/\"kube-root-ca.crt\""
Jul 30 21:20:47.818564 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.818540    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkmk7/must-gather-xdrsm"]
Jul 30 21:20:47.961893 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.961848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1763494a-3c40-48d6-9412-6f3c4fa47ada-must-gather-output\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:47.962114 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:47.961904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjvh\" (UniqueName: \"kubernetes.io/projected/1763494a-3c40-48d6-9412-6f3c4fa47ada-kube-api-access-czjvh\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.062961 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.062852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjvh\" (UniqueName: \"kubernetes.io/projected/1763494a-3c40-48d6-9412-6f3c4fa47ada-kube-api-access-czjvh\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.063139 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.063001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1763494a-3c40-48d6-9412-6f3c4fa47ada-must-gather-output\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.063308 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.063290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1763494a-3c40-48d6-9412-6f3c4fa47ada-must-gather-output\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.072009 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.071981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjvh\" (UniqueName: \"kubernetes.io/projected/1763494a-3c40-48d6-9412-6f3c4fa47ada-kube-api-access-czjvh\") pod \"must-gather-xdrsm\" (UID: \"1763494a-3c40-48d6-9412-6f3c4fa47ada\") " pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.122298 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.122259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkmk7/must-gather-xdrsm"
Jul 30 21:20:48.260779 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.260750    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkmk7/must-gather-xdrsm"]
Jul 30 21:20:48.263032 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:20:48.263003    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1763494a_3c40_48d6_9412_6f3c4fa47ada.slice/crio-f33d055cc2a4d7759ec02d58245fdaccd651359fd622a9b1c0aca67c84144a16 WatchSource:0}: Error finding container f33d055cc2a4d7759ec02d58245fdaccd651359fd622a9b1c0aca67c84144a16: Status 404 returned error can't find the container with id f33d055cc2a4d7759ec02d58245fdaccd651359fd622a9b1c0aca67c84144a16
Jul 30 21:20:48.470071 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:48.469988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkmk7/must-gather-xdrsm" event={"ID":"1763494a-3c40-48d6-9412-6f3c4fa47ada","Type":"ContainerStarted","Data":"f33d055cc2a4d7759ec02d58245fdaccd651359fd622a9b1c0aca67c84144a16"}
Jul 30 21:20:49.480049 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:49.480000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkmk7/must-gather-xdrsm" event={"ID":"1763494a-3c40-48d6-9412-6f3c4fa47ada","Type":"ContainerStarted","Data":"6431dc899a4db285fb6615b929923a0e4fea0583b2c96959c36d311f23473a88"}
Jul 30 21:20:49.480507 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:49.480053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkmk7/must-gather-xdrsm" event={"ID":"1763494a-3c40-48d6-9412-6f3c4fa47ada","Type":"ContainerStarted","Data":"42d377c74551f21b10b6701248ee4e8793fac89bd757d987ba71a60d01e1e84c"}
Jul 30 21:20:49.497542 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:49.497487    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dkmk7/must-gather-xdrsm" podStartSLOduration=1.75332055 podStartE2EDuration="2.497468243s" totalImagesPullingTime="744.147693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:20:49.496127678 +0000 UTC m=+3577.259048212" watchObservedRunningTime="2026-07-30 21:20:49.497468243 +0000 UTC m=+3577.260388776"
Jul 30 21:20:50.673043 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:50.673012    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9vtn_21c16074-1a8f-4b64-928f-97d5d546fa1f/global-pull-secret-syncer/0.log"
Jul 30 21:20:50.758721 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:50.758674    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cdnwm_4f6653e8-4c5b-432e-b1a0-e7c84d86beca/konnectivity-agent/0.log"
Jul 30 21:20:50.860056 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:50.860012    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-180.ec2.internal_1c9dc975cd59a33670a37382999ae928/haproxy/0.log"
Jul 30 21:20:56.305602 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:56.305532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78fcb895fc-gdh7k_c8cbe78d-14fe-4f3b-beea-ce5b8b69dbfe/authorino/0.log"
Jul 30 21:20:56.362984 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:56.362938    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-msk29_5afb0569-cec5-4bef-8076-2686be32ed44/manager/0.log"
Jul 30 21:20:57.904056 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:57.904022    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/alertmanager/0.log"
Jul 30 21:20:57.944776 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:57.944703    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/config-reloader/0.log"
Jul 30 21:20:57.986594 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:57.986532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/kube-rbac-proxy-web/0.log"
Jul 30 21:20:58.032846 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.032817    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/kube-rbac-proxy/0.log"
Jul 30 21:20:58.078018 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.077935    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/kube-rbac-proxy-metric/0.log"
Jul 30 21:20:58.125957 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.125917    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/prom-label-proxy/0.log"
Jul 30 21:20:58.163357 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.163319    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bf5b5fb8-3d88-4dc4-89a2-0772aa0b03fb/init-config-reloader/0.log"
Jul 30 21:20:58.269705 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.268800    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-p85pb_8ca2de02-3954-4d95-830f-b04db42ad572/kube-state-metrics/0.log"
Jul 30 21:20:58.301966 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.301739    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-p85pb_8ca2de02-3954-4d95-830f-b04db42ad572/kube-rbac-proxy-main/0.log"
Jul 30 21:20:58.332745 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.332631    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-p85pb_8ca2de02-3954-4d95-830f-b04db42ad572/kube-rbac-proxy-self/0.log"
Jul 30 21:20:58.375453 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.375425    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f97fc9b75-rfxg7_26fba55c-a706-4d1a-8eab-19834a7141b7/metrics-server/0.log"
Jul 30 21:20:58.530406 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.530370    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kvq9r_3aa74161-e0d2-43b8-9879-52cf87d36d09/node-exporter/0.log"
Jul 30 21:20:58.557190 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.557141    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kvq9r_3aa74161-e0d2-43b8-9879-52cf87d36d09/kube-rbac-proxy/0.log"
Jul 30 21:20:58.584060 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.583964    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kvq9r_3aa74161-e0d2-43b8-9879-52cf87d36d09/init-textfile/0.log"
Jul 30 21:20:58.696388 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.696354    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m28db_9fc2bd71-7c47-4878-bbab-089e31ffdd4a/kube-rbac-proxy-main/0.log"
Jul 30 21:20:58.720212 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.720157    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m28db_9fc2bd71-7c47-4878-bbab-089e31ffdd4a/kube-rbac-proxy-self/0.log"
Jul 30 21:20:58.741624 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.741580    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-m28db_9fc2bd71-7c47-4878-bbab-089e31ffdd4a/openshift-state-metrics/0.log"
Jul 30 21:20:58.790762 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.790723    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/prometheus/0.log"
Jul 30 21:20:58.813061 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.813031    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/config-reloader/0.log"
Jul 30 21:20:58.840815 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.840726    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/thanos-sidecar/0.log"
Jul 30 21:20:58.866150 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.866118    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/kube-rbac-proxy-web/0.log"
Jul 30 21:20:58.889551 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.889526    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/kube-rbac-proxy/0.log"
Jul 30 21:20:58.911280 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.911251    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/kube-rbac-proxy-thanos/0.log"
Jul 30 21:20:58.934542 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.934506    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6b35137b-ed5a-4ec0-8035-24f27de8fc63/init-config-reloader/0.log"
Jul 30 21:20:58.966441 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.966399    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-6gdgf_b0df97c4-d860-44b6-8c57-02bc64a114b1/prometheus-operator/0.log"
Jul 30 21:20:58.987425 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:58.987397    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-6gdgf_b0df97c4-d860-44b6-8c57-02bc64a114b1/kube-rbac-proxy/0.log"
Jul 30 21:20:59.014842 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.014814    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-fmj7f_cb8b3188-3c0f-4ef0-837b-5220de22f565/prometheus-operator-admission-webhook/0.log"
Jul 30 21:20:59.047656 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.045957    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f9ff958-2w8gq_348a5d48-8e01-49b1-982f-080afacd5178/telemeter-client/0.log"
Jul 30 21:20:59.072623 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.072597    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f9ff958-2w8gq_348a5d48-8e01-49b1-982f-080afacd5178/reload/0.log"
Jul 30 21:20:59.097565 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.097443    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-66f9ff958-2w8gq_348a5d48-8e01-49b1-982f-080afacd5178/kube-rbac-proxy/0.log"
Jul 30 21:20:59.130985 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.130948    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/thanos-query/0.log"
Jul 30 21:20:59.153481 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.153453    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/kube-rbac-proxy-web/0.log"
Jul 30 21:20:59.175053 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.175023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/kube-rbac-proxy/0.log"
Jul 30 21:20:59.197018 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.196991    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/prom-label-proxy/0.log"
Jul 30 21:20:59.219352 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.219314    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/kube-rbac-proxy-rules/0.log"
Jul 30 21:20:59.241596 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:20:59.241562    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-868979c4cc-w7dfp_09fb661b-f022-4ce9-bfc9-5019ca3141c8/kube-rbac-proxy-metrics/0.log"
Jul 30 21:21:00.524187 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:00.524151    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-r58hb_c7124637-e339-447e-9a13-b5d23232dfb4/networking-console-plugin/0.log"
Jul 30 21:21:01.153867 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.153827    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"]
Jul 30 21:21:01.159668 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.159640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.164056 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.164022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"]
Jul 30 21:21:01.240115 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.240077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-sys\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.240416 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.240396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-proc\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.240703 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.240663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-podres\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.240849 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.240833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-lib-modules\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.240976 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.240960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cqfd\" (UniqueName: \"kubernetes.io/projected/8c6ce911-a34a-420e-a1f4-570f62358220-kube-api-access-8cqfd\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.341796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cqfd\" (UniqueName: \"kubernetes.io/projected/8c6ce911-a34a-420e-a1f4-570f62358220-kube-api-access-8cqfd\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.341864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-sys\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.341889    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-proc\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-podres\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-lib-modules\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-proc\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-lib-modules\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342230 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-sys\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.342832 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.342281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c6ce911-a34a-420e-a1f4-570f62358220-podres\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.350425 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.350397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cqfd\" (UniqueName: \"kubernetes.io/projected/8c6ce911-a34a-420e-a1f4-570f62358220-kube-api-access-8cqfd\") pod \"perf-node-gather-daemonset-9hb6j\" (UID: \"8c6ce911-a34a-420e-a1f4-570f62358220\") " pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.478878 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.478848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:01.673493 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.673456    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"]
Jul 30 21:21:01.675773 ip-10-0-142-180 kubenswrapper[2583]: W0730 21:21:01.675737    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c6ce911_a34a_420e_a1f4_570f62358220.slice/crio-3c870b8318235e5351f183dafb168764a179daf45543b529b7cbf9b3b49b6b7c WatchSource:0}: Error finding container 3c870b8318235e5351f183dafb168764a179daf45543b529b7cbf9b3b49b6b7c: Status 404 returned error can't find the container with id 3c870b8318235e5351f183dafb168764a179daf45543b529b7cbf9b3b49b6b7c
Jul 30 21:21:01.766038 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:01.766002    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-hx444_f2a11557-5bc4-4d94-b17d-4c8a9d893281/download-server/0.log"
Jul 30 21:21:02.591497 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:02.591451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j" event={"ID":"8c6ce911-a34a-420e-a1f4-570f62358220","Type":"ContainerStarted","Data":"37c5d222be80985f4ab0a10b732254afeefdd2412c000f93af0d724a922d9e27"}
Jul 30 21:21:02.591698 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:02.591520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j" event={"ID":"8c6ce911-a34a-420e-a1f4-570f62358220","Type":"ContainerStarted","Data":"3c870b8318235e5351f183dafb168764a179daf45543b529b7cbf9b3b49b6b7c"}
Jul 30 21:21:02.591698 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:02.591635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:02.608658 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:02.608589    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j" podStartSLOduration=1.608565456 podStartE2EDuration="1.608565456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 21:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:21:02.606246022 +0000 UTC m=+3590.369166569" watchObservedRunningTime="2026-07-30 21:21:02.608565456 +0000 UTC m=+3590.371485991"
Jul 30 21:21:03.583481 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:03.583447    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkll7_38538573-aa76-47d4-aea1-202c0de74b98/dns/0.log"
Jul 30 21:21:03.605432 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:03.605402    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkll7_38538573-aa76-47d4-aea1-202c0de74b98/kube-rbac-proxy/0.log"
Jul 30 21:21:03.651317 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:03.651284    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gl6w_5e559ea1-db0c-4813-96d4-36fd94044e75/dns-node-resolver/0.log"
Jul 30 21:21:04.282707 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:04.282612    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mbb46_29a9a83d-67a7-4c58-ba77-2b3d3f083d36/node-ca/0.log"
Jul 30 21:21:05.443670 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:05.443638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c4ff7d78-gj8cm_b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab/kube-auth-proxy/0.log"
Jul 30 21:21:06.369482 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:06.369435    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kqt2h_4ed9e975-9725-4bad-a81b-31303769bf58/serve-healthcheck-canary/0.log"
Jul 30 21:21:07.066319 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:07.066285    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhzv2_027f733c-9659-4d3b-9493-f986c8fd8d76/kube-rbac-proxy/0.log"
Jul 30 21:21:07.089458 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:07.089428    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhzv2_027f733c-9659-4d3b-9493-f986c8fd8d76/exporter/0.log"
Jul 30 21:21:07.110974 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:07.110947    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nhzv2_027f733c-9659-4d3b-9493-f986c8fd8d76/extractor/0.log"
Jul 30 21:21:08.610052 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:08.610013    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dkmk7/perf-node-gather-daemonset-9hb6j"
Jul 30 21:21:09.927810 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:09.927773    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fb4f68b-sf8qp_e08c92d4-dcd4-4597-a979-5e0e94f4da5c/manager/0.log"
Jul 30 21:21:09.958143 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:09.958110    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58fb4f68b-sf8qp_e08c92d4-dcd4-4597-a979-5e0e94f4da5c/copy-manifests/0.log"
Jul 30 21:21:11.382175 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:11.382018    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-696d745bf6-j7mkw_ae59661a-5de4-4ca9-b78d-ec9442d8f77b/manager/0.log"
Jul 30 21:21:12.336454 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:12.336424    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c4ff7d78-gj8cm_b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab/kube-auth-proxy/0.log"
Jul 30 21:21:14.085588 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:14.085554    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55c4ff7d78-gj8cm_b7d1ce8c-c86d-44a9-b6c7-c4d4d8eac9ab/kube-auth-proxy/0.log"
Jul 30 21:21:17.971782 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:17.971751    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/kube-multus-additional-cni-plugins/0.log"
Jul 30 21:21:17.992512 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:17.992463    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/egress-router-binary-copy/0.log"
Jul 30 21:21:18.013327 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.013303    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/cni-plugins/0.log"
Jul 30 21:21:18.037218 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.037188    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/bond-cni-plugin/0.log"
Jul 30 21:21:18.059469 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.059440    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/routeoverride-cni/0.log"
Jul 30 21:21:18.082260 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.082235    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/whereabouts-cni-bincopy/0.log"
Jul 30 21:21:18.103605 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.103571    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rjrvx_8fbc0d92-e937-4036-a986-5fb00541214b/whereabouts-cni/0.log"
Jul 30 21:21:18.341064 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.341020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r4mzh_402f86ca-489f-4fd7-b95c-cfe1d3528d2f/kube-multus/0.log"
Jul 30 21:21:18.393222 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.393189    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8v5lt_83b7df1b-3a67-452f-b7cf-1b40fae23455/network-metrics-daemon/0.log"
Jul 30 21:21:18.411645 ip-10-0-142-180 kubenswrapper[2583]: I0730 21:21:18.411600    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8v5lt_83b7df1b-3a67-452f-b7cf-1b40fae23455/kube-rbac-proxy/0.log"