Jul 25 00:34:02.028436 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 25 00:34:02.028450 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 25 00:34:02.028460 ip-10-0-136-9 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 25 00:34:02.028796 ip-10-0-136-9 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 25 00:34:11.650442 ip-10-0-136-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 25 00:34:11.650457 ip-10-0-136-9 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a5a6f21a4bf6422db42398ace45db21f --
Jul 25 00:35:59.836352 ip-10-0-136-9 systemd[1]: Starting Kubernetes Kubelet...
Jul 25 00:36:00.244208 ip-10-0-136-9 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 00:36:00.244208 ip-10-0-136-9 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 25 00:36:00.244208 ip-10-0-136-9 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 00:36:00.244208 ip-10-0-136-9 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 25 00:36:00.244208 ip-10-0-136-9 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 25 00:36:00.244865 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.244269    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 25 00:36:00.247810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247794    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.247810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247809    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247813    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247816    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247820    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247823    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247825    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247828    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247831    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247833    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247836    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247851    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247854    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247856    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247859    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247862    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247864    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247868    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247871    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247874    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247877    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.247874 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247880    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247883    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247886    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247888    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247891    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247894    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247897    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247899    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247902    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247904    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247907    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247909    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247912    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247914    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247917    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247920    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247922    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247926    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247930    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.248371 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247933    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247936    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247938    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247941    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247943    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247946    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247950    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247953    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247956    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247959    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247963    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247966    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247969    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247972    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247975    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247978    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247981    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247984    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247987    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.248863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247990    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247993    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247995    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.247998    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248001    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248003    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248006    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248008    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248011    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248014    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248016    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248019    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248022    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248024    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248027    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248030    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248033    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248036    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248039    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248041    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.249344 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248044    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248047    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248049    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248052    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248067    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248070    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248073    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248076    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248079    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248081    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248085    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248088    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248090    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248093    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248095    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248098    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248101    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248105    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248107    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248110    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.249821 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248840    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248847    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248851    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248855    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248858    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248862    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248865    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248868    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248871    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248874    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248877    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248880    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248883    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248886    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248889    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248891    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248894    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248897    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248899    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248902    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.250320 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248905    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248908    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248910    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248913    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248916    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248918    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248921    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248924    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248926    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248929    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248931    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248934    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248936    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248939    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248941    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248944    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248947    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248950    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248956    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248959    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.250809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248962    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248964    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248967    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248969    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248972    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248975    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248977    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248980    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248983    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248985    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248988    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248991    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248995    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.248998    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249001    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249004    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249008    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249012    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249016    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.251306 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249018    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249021    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249023    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249026    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249029    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249031    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249034    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249036    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249039    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249041    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249044    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249047    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249071    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249075    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249078    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249080    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249083    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249085    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249088    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.251802 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249091    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249093    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249097    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249100    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249104    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249109    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249112    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249115    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249118    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249121    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249123    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249126    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249129    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249132    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249135    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249137    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249140    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249143    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249145    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.252269 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249148    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249151    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249517    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249522    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249525    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249530    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249534    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249537    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249540    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249543    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249546    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249549    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249552    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249554    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249557    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249560    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249563    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249566    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.252754 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249569    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249571    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249574    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249577    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249580    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249582    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249585    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249587    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249590    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249592    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249595    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249598    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249601    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249603    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249606    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249608    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249611    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249614    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249617    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249620    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.253218 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249622    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249626    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249629    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249631    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249634    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249636    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249639    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249641    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249644    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249647    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249649    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249652    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249655    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249658    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249660    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249663    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249666    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249668    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249670    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249673    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249675    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.253692 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249678    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249680    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249683    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249685    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249688    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249690    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249693    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249696    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249700    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249703    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249707    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249710    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249713    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249716    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249719    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249722    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249724    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249727    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249730    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.254229 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249733    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249735    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249738    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249741    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249743    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249746    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249748    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249752    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249754    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249757    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249760    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249762    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249765    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249767    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249770    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249772    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249775    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249778    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249781    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249784    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.254679 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249789    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249792    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.249794    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249868    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249880    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249886    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249890    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249894    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249898    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249902    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249906    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249909    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249912    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249916    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249919    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249922    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249925    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249928    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249931    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249935    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249937    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249942    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249946    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249949    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 25 00:36:00.255169 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249952    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249955    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249959    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249962    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249965    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249969    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249972    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249975    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249979    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249982    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249985    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249990    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249993    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249996    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.249999    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250002    2574 flags.go:64] FLAG: --enable-server="true"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250005    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250010    2574 flags.go:64] FLAG: --event-burst="100"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250013    2574 flags.go:64] FLAG: --event-qps="50"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250016    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250019    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250022    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250026    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250029    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250032    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 25 00:36:00.255743 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250035    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250038    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250041    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250044    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250046    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250049    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250052    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250070    2574 flags.go:64] FLAG: --feature-gates=""
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250074    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250077    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250080    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250083    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250086    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250089    2574 flags.go:64] FLAG: --help="false"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250092    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250097    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250100    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250103    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250107    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250110    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250113    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250116    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250119    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 25 00:36:00.256345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250122    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250125    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250128    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250131    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250134    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250137    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250140    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250143    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250146    2574 flags.go:64] FLAG: --lock-file=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250148    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250151    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250155    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250160    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250163    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250166    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250168    2574 flags.go:64] FLAG: --logging-format="text"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250171    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250175    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250177    2574 flags.go:64] FLAG: --manifest-url=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250180    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250184    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250187    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250191    2574 flags.go:64] FLAG: --max-pods="110"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250194    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250199    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 25 00:36:00.256975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250202    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250205    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250208    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250211    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250214    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250221    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250224    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250227    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250230    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250233    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250239    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250242    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250245    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250248    2574 flags.go:64] FLAG: --port="10250"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250251    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250254    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03209209bca89125c"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250257    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250260    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250263    2574 flags.go:64] FLAG: --register-node="true"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250265    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250269    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250273    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250276    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250279    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250282    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 25 00:36:00.257606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250285    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250288    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250291    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250294    2574 flags.go:64] FLAG: --runonce="false"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250297    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250300    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250304    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250307    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250310    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250313    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250316    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250319    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250323    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250326    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250329    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250332    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250335    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250339    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250342    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250347    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250350    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250353    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250357    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250360    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250363    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 25 00:36:00.258234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250366    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250369    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250371    2574 flags.go:64] FLAG: --v="2"
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250377    2574 flags.go:64] FLAG: --version="false"
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250381    2574 flags.go:64] FLAG: --vmodule=""
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250384    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250388    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250501    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250505    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250508    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250512    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250516    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250520    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250524    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250527    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250530    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250532    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250535    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250538    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250541    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.258843 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250543    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250546    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250549    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250552    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250554    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250557    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250560    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250563    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250566    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250569    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250571    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250574    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250576    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250579    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250582    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250586    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250588    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250591    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250594    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.259522 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250596    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250599    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250601    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250604    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250607    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250609    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250612    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250615    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250618    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250621    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250623    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250626    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250628    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250631    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250633    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250636    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250639    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250641    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250644    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250647    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.260236 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250650    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250653    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250656    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250658    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250661    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250664    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250668    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250672    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250676    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250678    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250681    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250684    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250687    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250689    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250692    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250695    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250697    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250700    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250703    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250705    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.260730 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250708    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250710    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250713    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250716    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250718    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250721    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250724    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250726    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250729    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250731    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250734    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250737    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250740    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250742    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250745    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250747    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250750    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250752    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250755    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250757    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250762    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.261347 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250764    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250767    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250769    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250772    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250775    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.250777    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.250783    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.257551    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.257567    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.257583    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.257589    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257658    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257664    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257668    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.261852 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257671    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257675    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257678    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257680    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257683    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257686    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257689    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257692    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257695    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257697    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257700    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257703    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257705    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257708    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257710    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257713    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257716    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257718    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257721    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257724    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.262327 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257726    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257729    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257731    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257734    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257736    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257739    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257743    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257746    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257749    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257752    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257754    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257757    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257759    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257762    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257764    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257767    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257769    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257772    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257774    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257777    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.262810 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257780    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257783    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257785    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257788    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257790    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257793    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257795    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257798    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257800    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257803    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257806    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257808    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257811    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257813    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257816    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257818    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257821    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257823    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257827    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257830    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.263403 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257833    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257835    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257838    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257841    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257845    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257848    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257852    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257855    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257857    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257860    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257862    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257865    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257867    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257870    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257872    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257875    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257878    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257881    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257885    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.263915 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257887    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257890    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257893    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257895    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257898    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257901    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257903    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257906    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257908    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257911    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257915    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257919    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257922    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257926    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257928    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257931    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.264400 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.257934    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.257939    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258078    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258084    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258087    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258090    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258093    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258095    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258098    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258101    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258103    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258106    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258109    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258112    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258114    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 25 00:36:00.264931 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258117    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258120    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258123    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258126    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258129    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258131    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258134    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258136    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258139    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258141    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258144    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258146    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258149    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258153    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258157    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258161    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258163    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258166    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258169    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258171    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 25 00:36:00.265325 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258174    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258177    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258180    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258182    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258185    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258187    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258189    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258192    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258194    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258197    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258200    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258202    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258204    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258208    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258212    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258215    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258217    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258220    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258223    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 25 00:36:00.266019 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258225    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258228    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258230    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258233    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258235    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258238    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258242    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258245    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258247    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258250    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258253    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258256    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258258    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258261    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258263    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258266    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258268    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258271    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258273    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258276    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 25 00:36:00.266542 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258278    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258281    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258284    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258287    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258290    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258293    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258296    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258298    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258301    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258303    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258306    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258308    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258311    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258313    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258316    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258318    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258321    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258323    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258328    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258331    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 25 00:36:00.267047 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258334    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258336    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258339    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258342    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258345    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258347    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:00.258350    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.258355    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.258455    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.263048    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.264442    2574 server.go:1019] "Starting client certificate rotation"
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.264562    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.264613    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 25 00:36:00.267937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.266981    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 25 00:36:00.268342 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.268082    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 25 00:36:00.278046 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.278029    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 25 00:36:00.282876 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.282859    2574 log.go:25] "Validated CRI v1 image API"
Jul 25 00:36:00.284294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.284277    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 25 00:36:00.287178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.287159    2574 fs.go:135] Filesystem UUIDs: map[32dfa3f4-398e-4ad0-b187-bbaff874aeed:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a5d54fa7-4793-4137-b193-5c8210addfa6:/dev/nvme0n1p3]
Jul 25 00:36:00.287240 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.287177    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 25 00:36:00.292105 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.291978    2574 manager.go:216] Machine: {Timestamp:2026-07-25 00:36:00.290751788 +0000 UTC m=+0.338479775 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092489 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb9bcbda5395125498a5ec9ab7af5 SystemUUID:ec2eb9bc-bda5-3951-2549-8a5ec9ab7af5 BootID:a5a6f21a-4bf6-422d-b423-98ace45db21f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:6f:03:bd:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:6f:03:bd:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:04:6b:34:16:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 25 00:36:00.292105 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.292100    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 25 00:36:00.292218 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.292206    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 25 00:36:00.295105 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.295090    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 25 00:36:00.295781 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.295754    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 25 00:36:00.295918 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.295784    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 25 00:36:00.296482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.296471    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 25 00:36:00.296518 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.296483    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 25 00:36:00.296518 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.296491    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 25 00:36:00.297125 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.297113    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 25 00:36:00.298341 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.298331    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 25 00:36:00.301306 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301295    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 25 00:36:00.301418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301409    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 25 00:36:00.301452 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301439    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 25 00:36:00.301480 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301452    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 25 00:36:00.301480 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301471    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 25 00:36:00.301532 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301480    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 25 00:36:00.301532 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301489    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 25 00:36:00.301826 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301808    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 25 00:36:00.301826 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.301829    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 25 00:36:00.304820 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.304796    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 25 00:36:00.306521 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.306502    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 25 00:36:00.306600 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.306534    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 25 00:36:00.307590 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307576    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 25 00:36:00.307590 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307591    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 25 00:36:00.307712 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307597    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 25 00:36:00.307712 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307603    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 25 00:36:00.307712 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307611    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 25 00:36:00.307712 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.307617    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 25 00:36:00.308242 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308233    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 25 00:36:00.308242 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308242    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 25 00:36:00.308305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308249    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 25 00:36:00.308305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308254    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 25 00:36:00.308305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308262    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 25 00:36:00.308305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.308270    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 25 00:36:00.309175 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.309166    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 25 00:36:00.309175 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.309175    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 25 00:36:00.312351 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.312334    2574 server.go:1268] "Started kubelet"
Jul 25 00:36:00.312491 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.312461    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 25 00:36:00.312813 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.312621    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 25 00:36:00.312813 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.312686    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 25 00:36:00.313236 ip-10-0-136-9 systemd[1]: Started Kubernetes Kubelet.
Jul 25 00:36:00.313438 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.313260    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 25 00:36:00.313837 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.313773    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 25 00:36:00.313837 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.313775    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 25 00:36:00.314252 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.314182    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 25 00:36:00.314549 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.314533    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 25 00:36:00.316512 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.316493    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tznl"
Jul 25 00:36:00.317589 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.317571    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 25 00:36:00.320391 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.320378    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 25 00:36:00.320466 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.320407    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 25 00:36:00.320518 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.320476    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.320998 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.320983    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 25 00:36:00.321122 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321105    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 25 00:36:00.321237 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321185    2574 factory.go:55] Registering systemd factory
Jul 25 00:36:00.321237 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321200    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 25 00:36:00.321339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321249    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 25 00:36:00.321339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321275    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 25 00:36:00.321339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.320983    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 25 00:36:00.321478 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321465    2574 factory.go:153] Registering CRI-O factory
Jul 25 00:36:00.321522 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321482    2574 factory.go:223] Registration of the crio container factory successfully
Jul 25 00:36:00.321564 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321543    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 25 00:36:00.321596 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321568    2574 factory.go:103] Registering Raw factory
Jul 25 00:36:00.321596 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.321584    2574 manager.go:1196] Started watching for new ooms in manager
Jul 25 00:36:00.322067 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.322041    2574 manager.go:349] Starting recovery of all containers
Jul 25 00:36:00.323202 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.322209    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18c5614146e2c362  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-25 00:36:00.312304482 +0000 UTC m=+0.360032467,LastTimestamp:2026-07-25 00:36:00.312304482 +0000 UTC m=+0.360032467,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}"
Jul 25 00:36:00.326178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.326149    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2tznl"
Jul 25 00:36:00.326381 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.326340    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 25 00:36:00.326601 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.326577    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 25 00:36:00.327781 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.327754    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 25 00:36:00.335220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.335194    2574 manager.go:354] Recovery completed
Jul 25 00:36:00.339889 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.339872    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.341655 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.341640    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.341726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.341672    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.341726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.341687    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.342197 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342185    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 25 00:36:00.342237 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342197    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 25 00:36:00.342237 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342215    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 25 00:36:00.342304 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342200    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.342876 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342861    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.342971 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342890    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.342971 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.342904    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.343428 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.343416    2574 policy_none.go:49] "None policy: Start"
Jul 25 00:36:00.343499 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.343432    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 25 00:36:00.343499 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.343442    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 25 00:36:00.343757 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.343691    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-9.ec2.internal.18c5614148a29abb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-9.ec2.internal,UID:ip-10-0-136-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-9.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-9.ec2.internal,},FirstTimestamp:2026-07-25 00:36:00.341654203 +0000 UTC m=+0.389382192,LastTimestamp:2026-07-25 00:36:00.341654203 +0000 UTC m=+0.389382192,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-9.ec2.internal,}"
Jul 25 00:36:00.344519 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.344508    2574 policy_none.go:47] "Start"
Jul 25 00:36:00.381921 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.381769    2574 manager.go:337] "Starting Device Plugin manager"
Jul 25 00:36:00.382038 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.381946    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 25 00:36:00.382038 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.381961    2574 server.go:87] "Starting device plugin registration server"
Jul 25 00:36:00.382239 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.382227    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 25 00:36:00.382278 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.382244    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 25 00:36:00.382358 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.382337    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 25 00:36:00.382443 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.382423    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 25 00:36:00.382443 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.382438    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 25 00:36:00.382947 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.382922    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 25 00:36:00.383015 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.382980    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.483357 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.483335    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.485337 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.484323    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.485337 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.484361    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.485337 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.484376    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.485337 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.484402    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.493354 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.493336    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.493451 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.493364    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.512496 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.512421    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.515357 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.515323    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 25 00:36:00.515450 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.515381    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 25 00:36:00.515450 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.515402    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 25 00:36:00.515450 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.515439    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 25 00:36:00.517849 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.517832    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 00:36:00.615183 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.615125    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.616317 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.616294    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"]
Jul 25 00:36:00.616387 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.616376    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.620639 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.620621    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.620761 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.620659    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.620761 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.620675    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.622128 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.622111    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.622262 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.622231    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.622312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.622270    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.622987 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.622970    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.622987 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.622980    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.623109 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623001    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.623109 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623004    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.623109 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623013    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.623109 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623029    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.623260 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623222    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.623303 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.623254    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.624361 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.624347    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.624406 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.624377    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 25 00:36:00.625092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.625065    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 00:36:00.625189 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.625102    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 00:36:00.625189 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.625113    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 00:36:00.643712 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.643690    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.648491 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.648471    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-9.ec2.internal\" not found" node="ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.716338 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.716309    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.724261 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.724241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d7ad4a6bb684f22efbfb85f952c0cad-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"9d7ad4a6bb684f22efbfb85f952c0cad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.724372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.724275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.724372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.724294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.724372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.724354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.724372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.724355    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f513fe9e2eacb32c201e974448cc2ff2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal\" (UID: \"f513fe9e2eacb32c201e974448cc2ff2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.817332 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.817249    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.824687 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.824663    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d7ad4a6bb684f22efbfb85f952c0cad-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"9d7ad4a6bb684f22efbfb85f952c0cad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.824829 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.824720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d7ad4a6bb684f22efbfb85f952c0cad-config\") pod \"kube-apiserver-proxy-ip-10-0-136-9.ec2.internal\" (UID: \"9d7ad4a6bb684f22efbfb85f952c0cad\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.919805 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:00.919746    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:00.947353 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.947311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:00.952111 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:00.952081    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:01.020773 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.020730    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.122619 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.122521    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.223516 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.223470    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.263594 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.263554    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 25 00:36:01.264084 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.263722    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 25 00:36:01.323772 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.323738    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.330965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.330917    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-24 00:31:00 +0000 UTC" deadline="2028-03-03 03:50:22.270758402 +0000 UTC"
Jul 25 00:36:01.330965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.330964    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14091h14m20.939799963s"
Jul 25 00:36:01.424984 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.424917    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.473656 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:01.473603    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7ad4a6bb684f22efbfb85f952c0cad.slice/crio-b884bea5479b30f0f14abde7ce94c1fb4f2c6cfc0a7d9c2afe448f39bdf518f1 WatchSource:0}: Error finding container b884bea5479b30f0f14abde7ce94c1fb4f2c6cfc0a7d9c2afe448f39bdf518f1: Status 404 returned error can't find the container with id b884bea5479b30f0f14abde7ce94c1fb4f2c6cfc0a7d9c2afe448f39bdf518f1
Jul 25 00:36:01.474129 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:01.474085    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf513fe9e2eacb32c201e974448cc2ff2.slice/crio-ab3f999b518cf3f24f0f342e7bbc47096aee1bfc488780761bb33e7b070575c8 WatchSource:0}: Error finding container ab3f999b518cf3f24f0f342e7bbc47096aee1bfc488780761bb33e7b070575c8: Status 404 returned error can't find the container with id ab3f999b518cf3f24f0f342e7bbc47096aee1bfc488780761bb33e7b070575c8
Jul 25 00:36:01.478487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.478467    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 00:36:01.499559 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.499537    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 00:36:01.519274 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.519230    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"9d7ad4a6bb684f22efbfb85f952c0cad","Type":"ContainerStarted","Data":"b884bea5479b30f0f14abde7ce94c1fb4f2c6cfc0a7d9c2afe448f39bdf518f1"}
Jul 25 00:36:01.520357 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.520337    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"f513fe9e2eacb32c201e974448cc2ff2","Type":"ContainerStarted","Data":"ab3f999b518cf3f24f0f342e7bbc47096aee1bfc488780761bb33e7b070575c8"}
Jul 25 00:36:01.526037 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.526021    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.626218 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.626167    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.728323 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.728225    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.783077 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.783047    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 00:36:01.829114 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:01.829078    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-9.ec2.internal\" not found"
Jul 25 00:36:01.856131 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.856103    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 00:36:01.924916 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.924879    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:01.938711 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.938684    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 25 00:36:01.940033 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.940016    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal"
Jul 25 00:36:01.948322 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:01.948300    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 25 00:36:02.302893 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.302860    2574 apiserver.go:52] "Watching apiserver"
Jul 25 00:36:02.314741 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.314705    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 25 00:36:02.316099 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.316068    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tf6h4","kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qmg28","openshift-dns/node-resolver-9f4fv","openshift-image-registry/node-ca-ncbs8","openshift-multus/multus-2bkfs","openshift-multus/multus-additional-cni-plugins-nnjl9","openshift-multus/network-metrics-daemon-2s69q","kube-system/konnectivity-agent-72hq9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal","openshift-network-diagnostics/network-check-target-bk8pb","openshift-network-operator/iptables-alerter-tbpnf","openshift-ovn-kubernetes/ovnkube-node-x6pcg"]
Jul 25 00:36:02.317961 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.317936    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.319895 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.319559    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.321235 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321213    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 25 00:36:02.321334 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321241    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.321334 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321265    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.321334 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321291    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 25 00:36:02.321334 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321318    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sp8wb\""
Jul 25 00:36:02.321543 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321240    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 25 00:36:02.321543 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321215    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 25 00:36:02.321810 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.321665    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.322221 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.322200    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.323272 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.323238    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.323506 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.323489    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qpwxd\""
Jul 25 00:36:02.324262 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.324242    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.324528 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.324512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rg2k4\""
Jul 25 00:36:02.324723 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.324707    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.324928 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.324912    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 25 00:36:02.325280 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.325262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.325590 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.325570    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.326172 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.326154    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.327193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.327174    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.327941 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.327918    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.328425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.328405    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.328670 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.328651    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vsx9v\""
Jul 25 00:36:02.328903 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.328882    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.329113 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.329094    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cn99w\""
Jul 25 00:36:02.329432 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.329413    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.329509 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.329492    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:02.329856 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.329837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.331456 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.331435    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sv9bh\""
Jul 25 00:36:02.331670 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.331651    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 25 00:36:02.331879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.331860    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.332093 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.332063    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 25 00:36:02.332453 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.332435    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 25 00:36:02.333038 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.333016    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.333423 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.333195    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.333493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.333480    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9lhzw\""
Jul 25 00:36:02.333831 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.333811    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 25 00:36:02.334071 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334053    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4jgts\""
Jul 25 00:36:02.334071 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334067    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 25 00:36:02.334353 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 25 00:36:02.334353 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334257    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.334580 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.334655 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334608    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 25 00:36:02.334655 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.334612    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:02.334655 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334554    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 25 00:36:02.334916 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-tmp-dir\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.334972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334929    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-os-release\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.334972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.335076 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.334981    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysconfig\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335076 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335009    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-systemd\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335211 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgmqr\" (UniqueName: \"kubernetes.io/projected/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-kube-api-access-pgmqr\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.335211 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9q4m\" (UniqueName: \"kubernetes.io/projected/c857467b-41b7-4d2e-af5b-9f5793be60e4-kube-api-access-p9q4m\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.335312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-modprobe-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335246    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-kubernetes\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335271    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-conf\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-etc-tuned\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.335483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-var-lib-kubelet\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335478    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cnibin\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335510    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hss\" (UniqueName: \"kubernetes.io/projected/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-kube-api-access-62hss\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335557    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-run\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335584    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txjv6\" (UniqueName: \"kubernetes.io/projected/f5775c95-8979-4302-a022-5c28f1a841f6-kube-api-access-txjv6\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-host\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335630    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-tmp\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-hosts-file\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335669    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335681    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.335732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335725    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-lib-modules\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335755    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-system-cni-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335797    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335855    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c857467b-41b7-4d2e-af5b-9f5793be60e4-iptables-alerter-script\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c857467b-41b7-4d2e-af5b-9f5793be60e4-host-slash\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.335917    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-sys\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.336193 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.336035    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vq97v\""
Jul 25 00:36:02.336489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.336344    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 25 00:36:02.336870 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.336849    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 25 00:36:02.337146 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.337106    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 25 00:36:02.337229 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.337217    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:02.337301 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.337276    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:02.358755 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.358723    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfg8d"
Jul 25 00:36:02.364016 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.363990    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cfg8d"
Jul 25 00:36:02.422356 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.422331    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 25 00:36:02.436250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c857467b-41b7-4d2e-af5b-9f5793be60e4-iptables-alerter-script\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-bin\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovn-node-metrics-cert\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7dkz\" (UniqueName: \"kubernetes.io/projected/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-kube-api-access-f7dkz\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-multus\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436369    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-socket-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.436401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-os-release\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-ovn\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436448    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfr5x\" (UniqueName: \"kubernetes.io/projected/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-kube-api-access-mfr5x\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436484    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysconfig\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-systemd\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-kubelet-config\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436561    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-netns\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-systemd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436625    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45bad3a3-8404-4ff1-a97b-a59685573ea3-host\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-netns\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436658    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-env-overrides\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436676    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-modprobe-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-kubernetes\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.436717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436721    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-conf\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436776    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436782    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c857467b-41b7-4d2e-af5b-9f5793be60e4-iptables-alerter-script\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45bad3a3-8404-4ff1-a97b-a59685573ea3-serviceca\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436899    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hss\" (UniqueName: \"kubernetes.io/projected/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-kube-api-access-62hss\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-systemd\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-systemd-units\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.436932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-os-release\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysconfig\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-k8s-cni-cncf-io\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437143    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-kubernetes\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437203    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-modprobe-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437256    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-bin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437256    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.437375 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-conf\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437289    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-etc-sysctl-d\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437311    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-kubelet\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437340    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9mfw\" (UniqueName: \"kubernetes.io/projected/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-kube-api-access-d9mfw\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkxql\" (UniqueName: \"kubernetes.io/projected/405d7439-fd68-4d47-abd1-726679edf674-kube-api-access-gkxql\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-run\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-agent-certs\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437479    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-etc-kubernetes\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437513    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-sys-fs\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-lib-modules\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-run\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-kubelet\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jqcn\" (UniqueName: \"kubernetes.io/projected/45bad3a3-8404-4ff1-a97b-a59685573ea3-kube-api-access-5jqcn\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cni-binary-copy\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437672    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.438329 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c857467b-41b7-4d2e-af5b-9f5793be60e4-host-slash\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-lib-modules\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c857467b-41b7-4d2e-af5b-9f5793be60e4-host-slash\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437792    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-system-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437849    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-os-release\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437874    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-conf-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-registration-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-sys\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437965    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-tmp-dir\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.437995    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-dbus\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438048    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438038    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-sys\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-konnectivity-ca\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438169    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-etc-selinux\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.439209 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgmqr\" (UniqueName: \"kubernetes.io/projected/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-kube-api-access-pgmqr\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438233    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-var-lib-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-node-log\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-socket-dir-parent\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9q4m\" (UniqueName: \"kubernetes.io/projected/c857467b-41b7-4d2e-af5b-9f5793be60e4-kube-api-access-p9q4m\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-etc-tuned\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438357    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-config\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438383    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cnibin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-tmp-dir\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438457    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-var-lib-kubelet\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cnibin\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-slash\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-hostroot\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438861    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-daemon-config\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txjv6\" (UniqueName: \"kubernetes.io/projected/f5775c95-8979-4302-a022-5c28f1a841f6-kube-api-access-txjv6\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-etc-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.440157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438945    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-log-socket\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cni-binary-copy\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.438972    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439064    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-var-lib-kubelet\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439117    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-cnibin\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439119    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-netd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-multus-certs\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439262    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-host\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-tmp\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-hosts-file\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-device-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-system-cni-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439476    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-script-lib\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439623    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-system-cni-dir\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439633    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-hosts-file\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.441015 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.439731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5775c95-8979-4302-a022-5c28f1a841f6-host\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.441757 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.440076    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.442994 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.442919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-etc-tuned\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.442994 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.442951    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f5775c95-8979-4302-a022-5c28f1a841f6-tmp\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.445622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.445580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hss\" (UniqueName: \"kubernetes.io/projected/4049a5f2-4b8d-4eef-9fc7-d96e787d6153-kube-api-access-62hss\") pod \"multus-additional-cni-plugins-nnjl9\" (UID: \"4049a5f2-4b8d-4eef-9fc7-d96e787d6153\") " pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.450248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.450220    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9q4m\" (UniqueName: \"kubernetes.io/projected/c857467b-41b7-4d2e-af5b-9f5793be60e4-kube-api-access-p9q4m\") pod \"iptables-alerter-tbpnf\" (UID: \"c857467b-41b7-4d2e-af5b-9f5793be60e4\") " pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.450414 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.450224    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgmqr\" (UniqueName: \"kubernetes.io/projected/ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1-kube-api-access-pgmqr\") pod \"node-resolver-9f4fv\" (UID: \"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1\") " pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.451098 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.451079    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txjv6\" (UniqueName: \"kubernetes.io/projected/f5775c95-8979-4302-a022-5c28f1a841f6-kube-api-access-txjv6\") pod \"tuned-qmg28\" (UID: \"f5775c95-8979-4302-a022-5c28f1a841f6\") " pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.540228 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540190    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-kubelet-config\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540239    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-netns\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-systemd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45bad3a3-8404-4ff1-a97b-a59685573ea3-host\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540317    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-netns\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540330    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-kubelet-config\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540358    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-env-overrides\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540389    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-systemd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540411    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45bad3a3-8404-4ff1-a97b-a59685573ea3-serviceca\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.540418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-netns\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540450    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45bad3a3-8404-4ff1-a97b-a59685573ea3-host\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-systemd-units\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540514    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-k8s-cni-cncf-io\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540570    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-bin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-kubelet\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9mfw\" (UniqueName: \"kubernetes.io/projected/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-kube-api-access-d9mfw\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkxql\" (UniqueName: \"kubernetes.io/projected/405d7439-fd68-4d47-abd1-726679edf674-kube-api-access-gkxql\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-agent-certs\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-etc-kubernetes\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-sys-fs\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-kubelet\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540766    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45bad3a3-8404-4ff1-a97b-a59685573ea3-serviceca\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540393    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-netns\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jqcn\" (UniqueName: \"kubernetes.io/projected/45bad3a3-8404-4ff1-a97b-a59685573ea3-kube-api-access-5jqcn\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.540953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cni-binary-copy\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-systemd-units\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-env-overrides\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-k8s-cni-cncf-io\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540905    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-system-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-os-release\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.540936    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540956    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-conf-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540986    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-bin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.541001    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:03.040970516 +0000 UTC m=+3.088698491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.540938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-conf-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-kubelet\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-registration-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-dbus\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.541879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-system-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541060    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541077    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-konnectivity-ca\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541094    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541104    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-os-release\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-etc-selinux\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541198    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-registration-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-etc-selinux\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541236    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-etc-kubernetes\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541254    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541273    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-var-lib-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-node-log\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541207    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-kubelet\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-var-lib-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-node-log\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541404    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-cni-dir\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.542753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-socket-dir-parent\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-sys-fs\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541447    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-config\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cnibin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541492    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-socket-dir-parent\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-slash\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.541475    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-hostroot\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cnibin\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541554    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-daemon-config\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4d5e10ab-478c-4e93-9954-650af6b36ed4-dbus\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.541573    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:03.041555225 +0000 UTC m=+3.089283203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541609    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-slash\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-etc-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-etc-openvswitch\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-log-socket\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541710    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.543627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541735    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-netd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541745    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-log-socket\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-multus-certs\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-device-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541807    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-run-ovn-kubernetes\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-hostroot\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541816    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-konnectivity-ca\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-script-lib\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-bin\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-netd\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovn-node-metrics-cert\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-run-multus-certs\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-cni-binary-copy\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541920    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7dkz\" (UniqueName: \"kubernetes.io/projected/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-kube-api-access-f7dkz\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541976    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-device-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-multus\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-host-cni-bin\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.544493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542016    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-socket-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-ovn\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-multus-daemon-config\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-host-var-lib-cni-multus\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542069    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfr5x\" (UniqueName: \"kubernetes.io/projected/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-kube-api-access-mfr5x\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-run-ovn\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.541985    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-config\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542182    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/405d7439-fd68-4d47-abd1-726679edf674-socket-dir\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.542517    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovnkube-script-lib\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.544784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3a0b8a59-6bc3-4e28-8a8a-fc90850da424-agent-certs\") pod \"konnectivity-agent-72hq9\" (UID: \"3a0b8a59-6bc3-4e28-8a8a-fc90850da424\") " pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.545402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.545018    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-ovn-node-metrics-cert\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.549539 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.549513    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:02.549539 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.549539    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:02.549714 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.549555    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:02.549714 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:02.549630    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:03.049611154 +0000 UTC m=+3.097339133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:02.552822 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.552791    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9mfw\" (UniqueName: \"kubernetes.io/projected/4869d647-9d6d-4e1a-a004-c5aaf817c4c8-kube-api-access-d9mfw\") pod \"multus-2bkfs\" (UID: \"4869d647-9d6d-4e1a-a004-c5aaf817c4c8\") " pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.553001 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.552947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jqcn\" (UniqueName: \"kubernetes.io/projected/45bad3a3-8404-4ff1-a97b-a59685573ea3-kube-api-access-5jqcn\") pod \"node-ca-ncbs8\" (UID: \"45bad3a3-8404-4ff1-a97b-a59685573ea3\") " pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.553081 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.553023    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7dkz\" (UniqueName: \"kubernetes.io/projected/cd2565be-5241-4bfe-b24f-39ce2bca0cfe-kube-api-access-f7dkz\") pod \"ovnkube-node-x6pcg\" (UID: \"cd2565be-5241-4bfe-b24f-39ce2bca0cfe\") " pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.553159 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.553096    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkxql\" (UniqueName: \"kubernetes.io/projected/405d7439-fd68-4d47-abd1-726679edf674-kube-api-access-gkxql\") pod \"aws-ebs-csi-driver-node-pv7v7\" (UID: \"405d7439-fd68-4d47-abd1-726679edf674\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:02.553598 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.553581    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfr5x\" (UniqueName: \"kubernetes.io/projected/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-kube-api-access-mfr5x\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:02.602400 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.602362    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 00:36:02.639741 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.639702    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nnjl9"
Jul 25 00:36:02.649195 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.649164    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tbpnf"
Jul 25 00:36:02.668417 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.668382    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qmg28"
Jul 25 00:36:02.674450 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.674422    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9f4fv"
Jul 25 00:36:02.682297 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.682274    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ncbs8"
Jul 25 00:36:02.691468 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.691446    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2bkfs"
Jul 25 00:36:02.698486 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.698467    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:02.707328 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.707311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:02.714092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:02.714057    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7"
Jul 25 00:36:03.046374 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:03.046301    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:03.046374 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:03.046341    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:03.046589 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.046469    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:03.046589 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.046480    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:03.046589 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.046533    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:04.046517517 +0000 UTC m=+4.094245492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:03.046589 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.046551    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:04.046542371 +0000 UTC m=+4.094270344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:03.147501 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:03.147462    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:03.147696 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.147673    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:03.147750 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.147711    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:03.147750 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.147727    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:03.147830 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:03.147800    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:04.147779756 +0000 UTC m=+4.195507752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:03.367262 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:03.367186    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 00:31:02 +0000 UTC" deadline="2027-12-21 07:53:26.263073506 +0000 UTC"
Jul 25 00:36:03.367262 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:03.367231    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12343h17m22.895862379s"
Jul 25 00:36:03.722664 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.722638    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4049a5f2_4b8d_4eef_9fc7_d96e787d6153.slice/crio-21ad0ab393efd3857c5d5dcd8b8c1f242f187e70e9294c05bd09db48132c95c8 WatchSource:0}: Error finding container 21ad0ab393efd3857c5d5dcd8b8c1f242f187e70e9294c05bd09db48132c95c8: Status 404 returned error can't find the container with id 21ad0ab393efd3857c5d5dcd8b8c1f242f187e70e9294c05bd09db48132c95c8
Jul 25 00:36:03.726898 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.726868    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4869d647_9d6d_4e1a_a004_c5aaf817c4c8.slice/crio-728bf78a6b52d8aac8210094ce6590b26ccc4ba3f6f57ec51d7518c7f69a5d2e WatchSource:0}: Error finding container 728bf78a6b52d8aac8210094ce6590b26ccc4ba3f6f57ec51d7518c7f69a5d2e: Status 404 returned error can't find the container with id 728bf78a6b52d8aac8210094ce6590b26ccc4ba3f6f57ec51d7518c7f69a5d2e
Jul 25 00:36:03.730272 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.730238    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bad3a3_8404_4ff1_a97b_a59685573ea3.slice/crio-ea897f680517138846a45cf18608c370d9b4822262c37450a6bee5b562d5bd49 WatchSource:0}: Error finding container ea897f680517138846a45cf18608c370d9b4822262c37450a6bee5b562d5bd49: Status 404 returned error can't find the container with id ea897f680517138846a45cf18608c370d9b4822262c37450a6bee5b562d5bd49
Jul 25 00:36:03.732814 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.732790    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc857467b_41b7_4d2e_af5b_9f5793be60e4.slice/crio-30e4dcc42e7d42d4273a0d9a3e0a791be73b3596b22b40267e9d5944da916d24 WatchSource:0}: Error finding container 30e4dcc42e7d42d4273a0d9a3e0a791be73b3596b22b40267e9d5944da916d24: Status 404 returned error can't find the container with id 30e4dcc42e7d42d4273a0d9a3e0a791be73b3596b22b40267e9d5944da916d24
Jul 25 00:36:03.734035 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.733972    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee98e7ff_4f12_4b4c_a1d4_c314c4a58db1.slice/crio-92ebb2c8c9200c02c81670be938a634b833dcd6de114c0e39528cee8dcc0421d WatchSource:0}: Error finding container 92ebb2c8c9200c02c81670be938a634b833dcd6de114c0e39528cee8dcc0421d: Status 404 returned error can't find the container with id 92ebb2c8c9200c02c81670be938a634b833dcd6de114c0e39528cee8dcc0421d
Jul 25 00:36:03.735005 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.734980    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0b8a59_6bc3_4e28_8a8a_fc90850da424.slice/crio-60026e72de02ff94811fe52ce8dacd23696db02176a872ae9af0c08d9c8e5a1a WatchSource:0}: Error finding container 60026e72de02ff94811fe52ce8dacd23696db02176a872ae9af0c08d9c8e5a1a: Status 404 returned error can't find the container with id 60026e72de02ff94811fe52ce8dacd23696db02176a872ae9af0c08d9c8e5a1a
Jul 25 00:36:03.735564 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.735545    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405d7439_fd68_4d47_abd1_726679edf674.slice/crio-60da2d6ca5b231a108b2f5bdab88e4b3a79265072404ba5606284e27a6a32f58 WatchSource:0}: Error finding container 60da2d6ca5b231a108b2f5bdab88e4b3a79265072404ba5606284e27a6a32f58: Status 404 returned error can't find the container with id 60da2d6ca5b231a108b2f5bdab88e4b3a79265072404ba5606284e27a6a32f58
Jul 25 00:36:03.736480 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.736455    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5775c95_8979_4302_a022_5c28f1a841f6.slice/crio-a99501b67c735395b192afd77d27119b0c51d56e2dcc9ee2d0327c782ddafa27 WatchSource:0}: Error finding container a99501b67c735395b192afd77d27119b0c51d56e2dcc9ee2d0327c782ddafa27: Status 404 returned error can't find the container with id a99501b67c735395b192afd77d27119b0c51d56e2dcc9ee2d0327c782ddafa27
Jul 25 00:36:03.738863 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:03.738841    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2565be_5241_4bfe_b24f_39ce2bca0cfe.slice/crio-0c81cb7a832e746e1f0ce40a1e51c85e4a08d34bcd7f3387fc0c77bde936f8d9 WatchSource:0}: Error finding container 0c81cb7a832e746e1f0ce40a1e51c85e4a08d34bcd7f3387fc0c77bde936f8d9: Status 404 returned error can't find the container with id 0c81cb7a832e746e1f0ce40a1e51c85e4a08d34bcd7f3387fc0c77bde936f8d9
Jul 25 00:36:04.055474 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.055249    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:04.055647 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.055416    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:04.055647 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.055552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:04.055647 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.055611    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:06.055591407 +0000 UTC m=+6.103319387 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:04.055764 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.055658    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:04.055764 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.055698    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:06.055686814 +0000 UTC m=+6.103414794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:04.156852 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.156814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:04.157048 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.157031    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:04.157147 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.157057    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:04.157147 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.157072    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:04.157267 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.157149    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:06.157129062 +0000 UTC m=+6.204857042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:04.367523 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.367391    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-24 00:31:02 +0000 UTC" deadline="2028-01-23 15:25:08.620100408 +0000 UTC"
Jul 25 00:36:04.367523 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.367462    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13142h49m4.252642367s"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.518902    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.519051    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.519526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.519633    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.519700    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:04.519902 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:04.519769    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:04.540674 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.540635    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" event={"ID":"9d7ad4a6bb684f22efbfb85f952c0cad","Type":"ContainerStarted","Data":"6b03cda9f59a90df6f5b01218281247e445d75fb4ab06d84adb22d654b595a52"}
Jul 25 00:36:04.556726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.556623    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7" event={"ID":"405d7439-fd68-4d47-abd1-726679edf674","Type":"ContainerStarted","Data":"60da2d6ca5b231a108b2f5bdab88e4b3a79265072404ba5606284e27a6a32f58"}
Jul 25 00:36:04.557479 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.557245    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-9.ec2.internal" podStartSLOduration=2.557227872 podStartE2EDuration="2.557227872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:04.55646652 +0000 UTC m=+4.604194520" watchObservedRunningTime="2026-07-25 00:36:04.557227872 +0000 UTC m=+4.604955871"
Jul 25 00:36:04.564566 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.564535    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncbs8" event={"ID":"45bad3a3-8404-4ff1-a97b-a59685573ea3","Type":"ContainerStarted","Data":"ea897f680517138846a45cf18608c370d9b4822262c37450a6bee5b562d5bd49"}
Jul 25 00:36:04.566837 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.566766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerStarted","Data":"21ad0ab393efd3857c5d5dcd8b8c1f242f187e70e9294c05bd09db48132c95c8"}
Jul 25 00:36:04.574157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.573974    2574 generic.go:356] "Generic (PLEG): container finished" podID="f513fe9e2eacb32c201e974448cc2ff2" containerID="99dae0e08ca1d59a1fdd41b8a202233cae0e1eb06b8b4fcabc5f1d062d85d7cb" exitCode=0
Jul 25 00:36:04.574157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.574052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"f513fe9e2eacb32c201e974448cc2ff2","Type":"ContainerDied","Data":"99dae0e08ca1d59a1fdd41b8a202233cae0e1eb06b8b4fcabc5f1d062d85d7cb"}
Jul 25 00:36:04.583754 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.583654    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"0c81cb7a832e746e1f0ce40a1e51c85e4a08d34bcd7f3387fc0c77bde936f8d9"}
Jul 25 00:36:04.594658 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.594595    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmg28" event={"ID":"f5775c95-8979-4302-a022-5c28f1a841f6","Type":"ContainerStarted","Data":"a99501b67c735395b192afd77d27119b0c51d56e2dcc9ee2d0327c782ddafa27"}
Jul 25 00:36:04.599541 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.599466    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72hq9" event={"ID":"3a0b8a59-6bc3-4e28-8a8a-fc90850da424","Type":"ContainerStarted","Data":"60026e72de02ff94811fe52ce8dacd23696db02176a872ae9af0c08d9c8e5a1a"}
Jul 25 00:36:04.608013 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.607943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9f4fv" event={"ID":"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1","Type":"ContainerStarted","Data":"92ebb2c8c9200c02c81670be938a634b833dcd6de114c0e39528cee8dcc0421d"}
Jul 25 00:36:04.613844 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.613761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tbpnf" event={"ID":"c857467b-41b7-4d2e-af5b-9f5793be60e4","Type":"ContainerStarted","Data":"30e4dcc42e7d42d4273a0d9a3e0a791be73b3596b22b40267e9d5944da916d24"}
Jul 25 00:36:04.632197 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:04.632156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bkfs" event={"ID":"4869d647-9d6d-4e1a-a004-c5aaf817c4c8","Type":"ContainerStarted","Data":"728bf78a6b52d8aac8210094ce6590b26ccc4ba3f6f57ec51d7518c7f69a5d2e"}
Jul 25 00:36:05.652674 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:05.652636    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" event={"ID":"f513fe9e2eacb32c201e974448cc2ff2","Type":"ContainerStarted","Data":"61f265b129da49c64a9ed91eb78d3196b4d91cfcc1636c14941aea9197363d4a"}
Jul 25 00:36:06.081544 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.081446    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:06.081544 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.081512    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:06.081766 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.081697    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:06.081766 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.081762    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:10.081744167 +0000 UTC m=+10.129472148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:06.082624 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.082190    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:06.082624 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.082246    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:10.082229078 +0000 UTC m=+10.129957068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:06.183414 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.182691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:06.183414 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.182891    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:06.183414 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.182915    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:06.183414 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.182931    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:06.183414 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.182996    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:10.182976126 +0000 UTC m=+10.230704106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:06.516771 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.516679    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:06.517007 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.516974    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:06.517125 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.517008    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:06.517125 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.517108    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:06.517269 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:06.517178    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:06.517269 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:06.517254    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:08.516728 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:08.516692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:08.517225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:08.516692    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:08.517225 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:08.516851    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:08.517225 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:08.516922    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:08.517225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:08.516706    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:08.517225 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:08.517020    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:10.117745 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.117711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:10.118227 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.117762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:10.118227 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.117875    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:10.118227 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.117891    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:10.118227 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.117947    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:18.117928951 +0000 UTC m=+18.165656938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:10.118227 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.117967    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:18.117956885 +0000 UTC m=+18.165684858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:10.218269 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.218233    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:10.218432 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.218405    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:10.218479 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.218432    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:10.218479 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.218444    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:10.218583 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.218501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:18.218482956 +0000 UTC m=+18.266210940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.519588    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.519699    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:10.519712    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.519709    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.519794    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:10.520133 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:10.519890    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:12.517459 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:12.517387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:12.518003 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:12.517387    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:12.518003 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:12.517512    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:12.518003 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:12.517529    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:12.518003 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:12.517655    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:12.518003 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:12.517738    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:14.516036 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:14.516012    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:14.516374 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:14.516013    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:14.516374 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:14.516128    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:14.516374 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:14.516023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:14.516374 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:14.516211    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:14.516374 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:14.516248    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:16.516453 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:16.516419    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:16.516965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:16.516416    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:16.516965 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:16.516558    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:16.516965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:16.516428    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:16.516965 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:16.516644    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:16.516965 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:16.516747    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:18.176663 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.176631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:18.177128 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.176684    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:18.177128 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.176777    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:18.177128 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.176798    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:18.177128 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.176850    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:36:34.176827152 +0000 UTC m=+34.224555142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:18.177128 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.176870    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:34.176861096 +0000 UTC m=+34.224589083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:18.277771 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.277733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:18.277925 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.277890    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:18.277925 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.277910    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:18.277925 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.277921    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:18.278034 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.277968    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:36:34.277955477 +0000 UTC m=+34.325683450 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:18.516510 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.516440    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:18.516647 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.516439    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:18.516647 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.516544    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:18.516647 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:18.516443    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:18.516829 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.516608    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:18.516829 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:18.516716    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:20.516609 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:20.516578    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:20.517177 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:20.516663    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:20.517177 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:20.516678    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:20.517177 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:20.516799    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:20.517177 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:20.516832    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:20.517177 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:20.516904    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:22.516732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.516471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:22.517312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.516475    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:22.517312 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:22.516818    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:22.517312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.516478    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:22.517312 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:22.516922    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:22.517312 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:22.517079    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:22.689931 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.689903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"11e36da767f5b497c0d4aa74d9575a135d7daece28678c1e2c66b2c2fcb0b9c3"}
Jul 25 00:36:22.690040 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.689976    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"1c277680fd2be67adb7026adf08a99e4520d2bb1c534aedacda5299c2847c37a"}
Jul 25 00:36:22.690040 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.690022    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"cc2a32f6d31e6d24f723449b0a5df04dce44b9b2306dad1f8ff90fb48aed25fa"}
Jul 25 00:36:22.690131 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.690052    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"afc6bdacee3ac8adf971cb0a85bf04147f69c1fc7ee1240dc9e9d24e615d32fc"}
Jul 25 00:36:22.691172 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.691151    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qmg28" event={"ID":"f5775c95-8979-4302-a022-5c28f1a841f6","Type":"ContainerStarted","Data":"cefcc313872d8864c9008ec10bd34d5fa6afa9836418052849b5dfce9ce979bc"}
Jul 25 00:36:22.692459 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.692434    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72hq9" event={"ID":"3a0b8a59-6bc3-4e28-8a8a-fc90850da424","Type":"ContainerStarted","Data":"620c3c4fafa1dc357ae7670fb8209ca3a65f99dda8924140f8a82078b22433d5"}
Jul 25 00:36:22.693646 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.693625    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9f4fv" event={"ID":"ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1","Type":"ContainerStarted","Data":"09d88e74f7ff6d72a6658d5cefa88d706d916f0be77200388eaaf7f97c7a7117"}
Jul 25 00:36:22.694977 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.694954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2bkfs" event={"ID":"4869d647-9d6d-4e1a-a004-c5aaf817c4c8","Type":"ContainerStarted","Data":"faf55f5904e0dc8d7075a047cc00c22a40c21c9c3c9ce7f1da03c794bf94931a"}
Jul 25 00:36:22.696277 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.696257    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7" event={"ID":"405d7439-fd68-4d47-abd1-726679edf674","Type":"ContainerStarted","Data":"ad4778dd2857dd42e54995bbb8c2eadc9b15b934fd5ef8a9e50e1a58ecf22629"}
Jul 25 00:36:22.697521 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.697503    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ncbs8" event={"ID":"45bad3a3-8404-4ff1-a97b-a59685573ea3","Type":"ContainerStarted","Data":"f3307f57252c048d6edd4e746d7e8fa47ec4742ebfa54a848e2f9429aeb92cd4"}
Jul 25 00:36:22.698955 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.698935    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="7fa160e593e54f737857d46ff544c1eee800383ff51ae14dc23e712f072ca03a" exitCode=0
Jul 25 00:36:22.699033 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.698962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"7fa160e593e54f737857d46ff544c1eee800383ff51ae14dc23e712f072ca03a"}
Jul 25 00:36:22.708834 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.708792    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qmg28" podStartSLOduration=3.236815763 podStartE2EDuration="21.708767383s" totalImagesPullingTime="18.47195162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:22.708645616 +0000 UTC m=+22.756373610" watchObservedRunningTime="2026-07-25 00:36:22.708767383 +0000 UTC m=+22.756495371"
Jul 25 00:36:22.709262 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.709241    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-9.ec2.internal" podStartSLOduration=20.709232505 podStartE2EDuration="20.709232505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:05.668795888 +0000 UTC m=+5.716523888" watchObservedRunningTime="2026-07-25 00:36:22.709232505 +0000 UTC m=+22.756960501"
Jul 25 00:36:22.722159 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.722127    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ncbs8" podStartSLOduration=3.247093865 podStartE2EDuration="21.722115263s" totalImagesPullingTime="18.475021398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:22.722106019 +0000 UTC m=+22.769834014" watchObservedRunningTime="2026-07-25 00:36:22.722115263 +0000 UTC m=+22.769843257"
Jul 25 00:36:22.758955 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.758916    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2bkfs" podStartSLOduration=3.221195407 podStartE2EDuration="21.758901207s" totalImagesPullingTime="18.5377058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:22.743580266 +0000 UTC m=+22.791308260" watchObservedRunningTime="2026-07-25 00:36:22.758901207 +0000 UTC m=+22.806629202"
Jul 25 00:36:22.759143 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.759122    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-72hq9" podStartSLOduration=10.918735525 podStartE2EDuration="21.759115139s" totalImagesPullingTime="10.840379614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:22.758754044 +0000 UTC m=+22.806482038" watchObservedRunningTime="2026-07-25 00:36:22.759115139 +0000 UTC m=+22.806843134"
Jul 25 00:36:22.801035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:22.800996    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9f4fv" podStartSLOduration=3.329965788 podStartE2EDuration="21.800982048s" totalImagesPullingTime="18.47101626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:22.800342601 +0000 UTC m=+22.848070619" watchObservedRunningTime="2026-07-25 00:36:22.800982048 +0000 UTC m=+22.848710043"
Jul 25 00:36:23.705606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:23.705570    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"37e1853eaec65a0f7fcb464fd81028138911005347b240973e4e7a75b4e49070"}
Jul 25 00:36:23.706087 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:23.705702    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"fee2ac55770bc44e37acf579fd8537d1858a9ee87f3bc2890af020c06e792551"}
Jul 25 00:36:23.707357 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:23.707328    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tbpnf" event={"ID":"c857467b-41b7-4d2e-af5b-9f5793be60e4","Type":"ContainerStarted","Data":"8e9df87f05a58533fbd05566b0f2294539eee5ddaa043a25ccc2a7e243c1dd26"}
Jul 25 00:36:23.711177 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:23.711122    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 25 00:36:23.721561 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:23.721521    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tbpnf" podStartSLOduration=4.249554848 podStartE2EDuration="22.721503361s" totalImagesPullingTime="18.471948513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:23.72109597 +0000 UTC m=+23.768823967" watchObservedRunningTime="2026-07-25 00:36:23.721503361 +0000 UTC m=+23.769231357"
Jul 25 00:36:24.398606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.398490    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-25T00:36:23.711135692Z","UUID":"21033e64-e9ce-44c2-96d8-eb29f745356f","Handler":null,"Name":"","Endpoint":""}
Jul 25 00:36:24.401129 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.400847    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 25 00:36:24.401129 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.400897    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 25 00:36:24.516211 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.516178    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:24.516211 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.516198    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:24.516449 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.516317    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:24.516449 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:24.516331    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:24.516449 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:24.516392    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:24.516606 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:24.516489    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:24.713765 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.713729    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7" event={"ID":"405d7439-fd68-4d47-abd1-726679edf674","Type":"ContainerStarted","Data":"f5937ce6af10f46589747877a36ea0fe207da2e935e6940bb391a9578d747217"}
Jul 25 00:36:24.786717 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.786685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:24.787252 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:24.787236    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:25.721312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:25.721265    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"8092c99b87f8455893d0bd429b1ed0b2ff52b562776a76343b10c4ebc9e7550e"}
Jul 25 00:36:25.723627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:25.723597    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7" event={"ID":"405d7439-fd68-4d47-abd1-726679edf674","Type":"ContainerStarted","Data":"4132bbee8aa020d90018381d8f35633e8a6242454e547d7c144f820ea47544ac"}
Jul 25 00:36:25.724022 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:25.723995    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:25.724337 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:25.724315    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-72hq9"
Jul 25 00:36:25.742130 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:25.742079    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pv7v7" podStartSLOduration=3.935454307 podStartE2EDuration="24.742042781s" totalImagesPullingTime="20.806588474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:25.741614985 +0000 UTC m=+25.789342981" watchObservedRunningTime="2026-07-25 00:36:25.742042781 +0000 UTC m=+25.789770775"
Jul 25 00:36:26.516093 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:26.516045    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:26.516267 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:26.516174    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:26.516267 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:26.516046    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:26.516267 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:26.516233    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:26.516394 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:26.516341    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:26.516448 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:26.516416    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:27.732326 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:27.732293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" event={"ID":"cd2565be-5241-4bfe-b24f-39ce2bca0cfe","Type":"ContainerStarted","Data":"a666a2610e4d3984f7fbe22e4951db034e95dd6dc0f8f615c9e48e2d959edc9d"}
Jul 25 00:36:27.733145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:27.732584    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:27.733145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:27.732667    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:27.748111 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:27.748093    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:27.785050 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:27.784999    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg" podStartSLOduration=8.252130503 podStartE2EDuration="26.784980544s" totalImagesPullingTime="18.532850041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:27.758421054 +0000 UTC m=+27.806149051" watchObservedRunningTime="2026-07-25 00:36:27.784980544 +0000 UTC m=+27.832708538"
Jul 25 00:36:28.516753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.516521    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:28.516932 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.516524    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:28.516932 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:28.516860    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:28.516932 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.516526    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:28.516932 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:28.516911    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:28.517138 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:28.516995    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:28.738833 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.738798    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="309471a4d3e43a96c3e4a453b9ad3a63a5ca24daa333bd0aeb2784a87b97186c" exitCode=0
Jul 25 00:36:28.739235 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.738880    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"309471a4d3e43a96c3e4a453b9ad3a63a5ca24daa333bd0aeb2784a87b97186c"}
Jul 25 00:36:28.739396 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.739371    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:28.755158 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:28.755140    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:36:29.579726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.579685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tf6h4"]
Jul 25 00:36:29.579956 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.579810    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:29.579956 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:29.579917    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:29.583116 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.583087    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bk8pb"]
Jul 25 00:36:29.583258 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.583203    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:29.583738 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:29.583305    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:29.583882 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.583862    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2s69q"]
Jul 25 00:36:29.583993 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:29.583967    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:29.584215 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:29.584071    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:30.744614 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:30.744576    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="bc1ae80b82740d117b96c7ed10971179637931f739915eff12b99a0e2fd25ef6" exitCode=0
Jul 25 00:36:30.745008 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:30.744667    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"bc1ae80b82740d117b96c7ed10971179637931f739915eff12b99a0e2fd25ef6"}
Jul 25 00:36:31.516451 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:31.516238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:31.516656 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:31.516268    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:31.516656 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:31.516551    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:31.516656 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:31.516643    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:31.516827 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:31.516278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:31.516827 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:31.516756    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:32.751138 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:32.751100    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="8f827e3200e9294e75d6702e6387df814b5b686e01365d9d146bf5ae749555d4" exitCode=0
Jul 25 00:36:32.751138 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:32.751143    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"8f827e3200e9294e75d6702e6387df814b5b686e01365d9d146bf5ae749555d4"}
Jul 25 00:36:33.515773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:33.515743    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:33.515951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:33.515877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:33.515951 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:33.515883    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bk8pb" podUID="d197bda7-60e6-48f2-b7a2-fd587a107c6c"
Jul 25 00:36:33.516318 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:33.516001    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tf6h4" podUID="4d5e10ab-478c-4e93-9954-650af6b36ed4"
Jul 25 00:36:33.516318 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:33.515884    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:33.516318 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:33.516168    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:36:34.194725 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.194683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:34.194725 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.194728    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:34.195405 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.194851    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:34.195405 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.194851    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:34.195405 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.194914    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret podName:4d5e10ab-478c-4e93-9954-650af6b36ed4 nodeName:}" failed. No retries permitted until 2026-07-25 00:37:06.194896863 +0000 UTC m=+66.242624856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret") pod "global-pull-secret-syncer-tf6h4" (UID: "4d5e10ab-478c-4e93-9954-650af6b36ed4") : object "kube-system"/"original-pull-secret" not registered
Jul 25 00:36:34.195405 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.194937    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:37:06.194924175 +0000 UTC m=+66.242652149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 25 00:36:34.295982 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.295947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:34.296184 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.296103    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 25 00:36:34.296184 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.296126    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 25 00:36:34.296184 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.296139    2574 projected.go:196] Error preparing data for projected volume kube-api-access-dncdc for pod openshift-network-diagnostics/network-check-target-bk8pb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:34.296345 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:34.296191    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc podName:d197bda7-60e6-48f2-b7a2-fd587a107c6c nodeName:}" failed. No retries permitted until 2026-07-25 00:37:06.296178562 +0000 UTC m=+66.343906538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dncdc" (UniqueName: "kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc") pod "network-check-target-bk8pb" (UID: "d197bda7-60e6-48f2-b7a2-fd587a107c6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 25 00:36:34.823917 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.823892    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeReady"
Jul 25 00:36:34.824085 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.824011    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 25 00:36:34.873037 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.873009    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h9kmd"]
Jul 25 00:36:34.875103 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.875084    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:34.878400 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.878376    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2m9l\""
Jul 25 00:36:34.878542 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.878505    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 25 00:36:34.878609 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.878597    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 25 00:36:34.881315 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.881293    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jthmf"]
Jul 25 00:36:34.883255 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.883232    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:34.885642 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.885619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vl845\""
Jul 25 00:36:34.886097 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.886030    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 25 00:36:34.886195 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.886096    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 25 00:36:34.886195 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.886035    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 25 00:36:34.886983 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.886928    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9kmd"]
Jul 25 00:36:34.893519 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:34.893500    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jthmf"]
Jul 25 00:36:35.001744 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eddaf8e-1986-4e84-8418-1f45a95379f5-tmp-dir\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.001908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49qp\" (UniqueName: \"kubernetes.io/projected/1eddaf8e-1986-4e84-8418-1f45a95379f5-kube-api-access-q49qp\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.001908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001796    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c13a777b-c88c-4114-bf41-ab5d5a7c203d-cert\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.001908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001839    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1eddaf8e-1986-4e84-8418-1f45a95379f5-config-volume\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.001908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm8ts\" (UniqueName: \"kubernetes.io/projected/c13a777b-c88c-4114-bf41-ab5d5a7c203d-kube-api-access-mm8ts\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.002104 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.001949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.102679 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102696    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eddaf8e-1986-4e84-8418-1f45a95379f5-tmp-dir\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q49qp\" (UniqueName: \"kubernetes.io/projected/1eddaf8e-1986-4e84-8418-1f45a95379f5-kube-api-access-q49qp\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c13a777b-c88c-4114-bf41-ab5d5a7c203d-cert\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1eddaf8e-1986-4e84-8418-1f45a95379f5-config-volume\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.102785    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm8ts\" (UniqueName: \"kubernetes.io/projected/c13a777b-c88c-4114-bf41-ab5d5a7c203d-kube-api-access-mm8ts\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:35.102787    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:35.102860 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:35.102854    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:35.60283479 +0000 UTC m=+35.650562765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:36:35.103325 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.103225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1eddaf8e-1986-4e84-8418-1f45a95379f5-tmp-dir\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.104182 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.104155    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1eddaf8e-1986-4e84-8418-1f45a95379f5-config-volume\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.107505 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.107484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c13a777b-c88c-4114-bf41-ab5d5a7c203d-cert\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.111528 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.111508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49qp\" (UniqueName: \"kubernetes.io/projected/1eddaf8e-1986-4e84-8418-1f45a95379f5-kube-api-access-q49qp\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.111638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.111600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm8ts\" (UniqueName: \"kubernetes.io/projected/c13a777b-c88c-4114-bf41-ab5d5a7c203d-kube-api-access-mm8ts\") pod \"ingress-canary-jthmf\" (UID: \"c13a777b-c88c-4114-bf41-ab5d5a7c203d\") " pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.195558 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.195528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jthmf"
Jul 25 00:36:35.516538 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.516498    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:36:35.516538 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.516530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:36:35.516789 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.516619    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:36:35.519972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.519944    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xdtb\""
Jul 25 00:36:35.519972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.519966    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 25 00:36:35.520203 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.519994    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kt6t\""
Jul 25 00:36:35.520203 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.520093    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 25 00:36:35.520203 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.520121    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 25 00:36:35.520361 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.520286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 25 00:36:35.607565 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:35.607533    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:35.607744 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:35.607652    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:35.607744 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:35.607711    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:36.607695427 +0000 UTC m=+36.655423419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:36:36.617629 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:36.617593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:36.618077 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:36.617718    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:36.618077 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:36.617785    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:38.617767238 +0000 UTC m=+38.665495230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:36:36.810514 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:36.810312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jthmf"]
Jul 25 00:36:36.813676 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:36:36.813638    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13a777b_c88c_4114_bf41_ab5d5a7c203d.slice/crio-f5b16ecfe409a1512b87b58f14ca01179ac7d76a58d39545cff2a2938df77c83 WatchSource:0}: Error finding container f5b16ecfe409a1512b87b58f14ca01179ac7d76a58d39545cff2a2938df77c83: Status 404 returned error can't find the container with id f5b16ecfe409a1512b87b58f14ca01179ac7d76a58d39545cff2a2938df77c83
Jul 25 00:36:37.771778 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:37.771741    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="5bdfff9670a033ebaf8400d82b0992c94b5f7c4510b80d9ee73577ccb68ea226" exitCode=0
Jul 25 00:36:37.772327 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:37.771837    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"5bdfff9670a033ebaf8400d82b0992c94b5f7c4510b80d9ee73577ccb68ea226"}
Jul 25 00:36:37.773726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:37.773696    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jthmf" event={"ID":"c13a777b-c88c-4114-bf41-ab5d5a7c203d","Type":"ContainerStarted","Data":"f5b16ecfe409a1512b87b58f14ca01179ac7d76a58d39545cff2a2938df77c83"}
Jul 25 00:36:38.633853 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:38.633807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:38.634021 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:38.633955    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:38.634117 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:38.634021    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:42.634004593 +0000 UTC m=+42.681732566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:36:38.780652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:38.780616    2574 generic.go:356] "Generic (PLEG): container finished" podID="4049a5f2-4b8d-4eef-9fc7-d96e787d6153" containerID="a7b06e88dbbfde6af7bf3b966c9c41d438206075a2d2732c3092a759b434fc36" exitCode=0
Jul 25 00:36:38.781117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:38.780679    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerDied","Data":"a7b06e88dbbfde6af7bf3b966c9c41d438206075a2d2732c3092a759b434fc36"}
Jul 25 00:36:39.789451 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:39.789269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" event={"ID":"4049a5f2-4b8d-4eef-9fc7-d96e787d6153","Type":"ContainerStarted","Data":"14dc23bc1567c98c1f0312cfad2699cc68016069d3dc9b9925c4cec13725928b"}
Jul 25 00:36:39.790660 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:39.790637    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jthmf" event={"ID":"c13a777b-c88c-4114-bf41-ab5d5a7c203d","Type":"ContainerStarted","Data":"6f7304b6ddb9b5ff170d2188c79e14909c85b6a0a5e20fd7bb9b2b302327ba8b"}
Jul 25 00:36:39.812198 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:39.812150    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nnjl9" podStartSLOduration=9.140303261 podStartE2EDuration="38.812138014s" totalImagesPullingTime="29.671834753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:39.810970037 +0000 UTC m=+39.858698068" watchObservedRunningTime="2026-07-25 00:36:39.812138014 +0000 UTC m=+39.859866006"
Jul 25 00:36:39.826006 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:39.825959    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jthmf" podStartSLOduration=3.128329054 podStartE2EDuration="5.825945449s" totalImagesPullingTime="2.697616395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:36:39.825812497 +0000 UTC m=+39.873540553" watchObservedRunningTime="2026-07-25 00:36:39.825945449 +0000 UTC m=+39.873673447"
Jul 25 00:36:42.663407 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:42.663362    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:42.663794 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:42.663475    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:42.663794 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:42.663528    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:36:50.663514554 +0000 UTC m=+50.711242528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:36:50.715574 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:36:50.715532    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:36:50.715993 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:50.715654    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:36:50.715993 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:36:50.715719    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:37:06.715702175 +0000 UTC m=+66.763430149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:37:00.763656 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:00.763623    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x6pcg"
Jul 25 00:37:06.223293 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.223240    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:37:06.223293 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.223296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:37:06.225772 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.225753    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 25 00:37:06.225973 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.225961    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 25 00:37:06.233569 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:06.233547    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 25 00:37:06.233645 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:06.233620    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:38:10.23359843 +0000 UTC m=+130.281326417 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : secret "metrics-daemon-secret" not found
Jul 25 00:37:06.237117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.237100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4d5e10ab-478c-4e93-9954-650af6b36ed4-original-pull-secret\") pod \"global-pull-secret-syncer-tf6h4\" (UID: \"4d5e10ab-478c-4e93-9954-650af6b36ed4\") " pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:37:06.323767 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.323725    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:37:06.327180 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.327163    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 25 00:37:06.336773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.336751    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 25 00:37:06.347650 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.347627    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncdc\" (UniqueName: \"kubernetes.io/projected/d197bda7-60e6-48f2-b7a2-fd587a107c6c-kube-api-access-dncdc\") pod \"network-check-target-bk8pb\" (UID: \"d197bda7-60e6-48f2-b7a2-fd587a107c6c\") " pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:37:06.428985 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.428948    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tf6h4"
Jul 25 00:37:06.439068 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.439033    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kt6t\""
Jul 25 00:37:06.446224 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.446204    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:37:06.557400 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.557362    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tf6h4"]
Jul 25 00:37:06.561252 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:37:06.561228    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e10ab_478c_4e93_9954_650af6b36ed4.slice/crio-87498f60f11e1b16f82650dc7475b3449485895404b0a7959dafd44ba0ca2725 WatchSource:0}: Error finding container 87498f60f11e1b16f82650dc7475b3449485895404b0a7959dafd44ba0ca2725: Status 404 returned error can't find the container with id 87498f60f11e1b16f82650dc7475b3449485895404b0a7959dafd44ba0ca2725
Jul 25 00:37:06.571571 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.571548    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bk8pb"]
Jul 25 00:37:06.573960 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:37:06.573937    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd197bda7_60e6_48f2_b7a2_fd587a107c6c.slice/crio-2ae631f659a27dbd285dda16759c9825fc97a142c3044ab12e8ae9a3414c9369 WatchSource:0}: Error finding container 2ae631f659a27dbd285dda16759c9825fc97a142c3044ab12e8ae9a3414c9369: Status 404 returned error can't find the container with id 2ae631f659a27dbd285dda16759c9825fc97a142c3044ab12e8ae9a3414c9369
Jul 25 00:37:06.727673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.727594    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:37:06.727812 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:06.727708    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:37:06.727812 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:06.727766    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:37:38.727750015 +0000 UTC m=+98.775478007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:37:06.852622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.852533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tf6h4" event={"ID":"4d5e10ab-478c-4e93-9954-650af6b36ed4","Type":"ContainerStarted","Data":"87498f60f11e1b16f82650dc7475b3449485895404b0a7959dafd44ba0ca2725"}
Jul 25 00:37:06.853689 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:06.853659    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bk8pb" event={"ID":"d197bda7-60e6-48f2-b7a2-fd587a107c6c","Type":"ContainerStarted","Data":"2ae631f659a27dbd285dda16759c9825fc97a142c3044ab12e8ae9a3414c9369"}
Jul 25 00:37:11.868002 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:11.867962    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tf6h4" event={"ID":"4d5e10ab-478c-4e93-9954-650af6b36ed4","Type":"ContainerStarted","Data":"0cc60e582df0469a030ad55f9d733eb212bbdf42951fbb67f604ac5b2683f61b"}
Jul 25 00:37:11.869414 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:11.869390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bk8pb" event={"ID":"d197bda7-60e6-48f2-b7a2-fd587a107c6c","Type":"ContainerStarted","Data":"69cb0318fd736c6b29a2d71716035db3e89ed585c5df90494ac08be815725f55"}
Jul 25 00:37:11.869524 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:11.869454    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:37:11.884927 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:11.884887    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tf6h4" podStartSLOduration=66.474551545 podStartE2EDuration="1m10.884874773s" totalImagesPullingTime="4.410323228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:37:11.883777398 +0000 UTC m=+71.931505387" watchObservedRunningTime="2026-07-25 00:37:11.884874773 +0000 UTC m=+71.932602746"
Jul 25 00:37:11.898955 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:11.898913    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bk8pb" podStartSLOduration=66.504834925 podStartE2EDuration="1m10.898899653s" totalImagesPullingTime="4.394064728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:37:11.898165483 +0000 UTC m=+71.945893489" watchObservedRunningTime="2026-07-25 00:37:11.898899653 +0000 UTC m=+71.946627648"
Jul 25 00:37:21.731776 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.731737    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"]
Jul 25 00:37:21.733616 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.733594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.739828 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.739806    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 25 00:37:21.742538 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.742522    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 25 00:37:21.747032 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.747011    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 25 00:37:21.749946 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.749932    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 25 00:37:21.750200 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.750182    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wtgwf\""
Jul 25 00:37:21.774367 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.774341    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"]
Jul 25 00:37:21.832411 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.832384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/523ac0cb-b62e-46e5-9bbd-8b23becfde91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.832566 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.832430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5fjg\" (UniqueName: \"kubernetes.io/projected/523ac0cb-b62e-46e5-9bbd-8b23becfde91-kube-api-access-v5fjg\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.933114 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.933075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/523ac0cb-b62e-46e5-9bbd-8b23becfde91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.933306 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.933138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5fjg\" (UniqueName: \"kubernetes.io/projected/523ac0cb-b62e-46e5-9bbd-8b23becfde91-kube-api-access-v5fjg\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.935790 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.935754    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/523ac0cb-b62e-46e5-9bbd-8b23becfde91-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:21.941542 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:21.941519    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5fjg\" (UniqueName: \"kubernetes.io/projected/523ac0cb-b62e-46e5-9bbd-8b23becfde91-kube-api-access-v5fjg\") pod \"managed-serviceaccount-addon-agent-65fcdc6d6-pklr7\" (UID: \"523ac0cb-b62e-46e5-9bbd-8b23becfde91\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:22.051971 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:22.051829    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"
Jul 25 00:37:22.169648 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:22.169619    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7"]
Jul 25 00:37:22.172940 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:37:22.172907    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod523ac0cb_b62e_46e5_9bbd_8b23becfde91.slice/crio-62fafaf22eff98ad992568c58a8c2f7f319de53f0f7309e92b63abd76cbc0816 WatchSource:0}: Error finding container 62fafaf22eff98ad992568c58a8c2f7f319de53f0f7309e92b63abd76cbc0816: Status 404 returned error can't find the container with id 62fafaf22eff98ad992568c58a8c2f7f319de53f0f7309e92b63abd76cbc0816
Jul 25 00:37:22.895745 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:22.895706    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7" event={"ID":"523ac0cb-b62e-46e5-9bbd-8b23becfde91","Type":"ContainerStarted","Data":"62fafaf22eff98ad992568c58a8c2f7f319de53f0f7309e92b63abd76cbc0816"}
Jul 25 00:37:26.907396 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:26.907363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7" event={"ID":"523ac0cb-b62e-46e5-9bbd-8b23becfde91","Type":"ContainerStarted","Data":"653fcad3bda2aa666dc215c6cedefca8c7b1ba155613fa7c55acb24c75a37951"}
Jul 25 00:37:26.923358 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:26.923302    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7" podStartSLOduration=1.671741111 podStartE2EDuration="5.923288378s" totalImagesPullingTime="4.251547267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:37:26.923040126 +0000 UTC m=+86.970768121" watchObservedRunningTime="2026-07-25 00:37:26.923288378 +0000 UTC m=+86.971016373"
Jul 25 00:37:38.756324 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:38.756295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:37:38.756693 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:38.756401    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:37:38.756693 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:37:38.756463    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:38:42.756449993 +0000 UTC m=+162.804177966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:37:42.873709 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:37:42.873680    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bk8pb"
Jul 25 00:38:10.263410 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:38:10.263373    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:38:10.263902 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:10.263508    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 25 00:38:10.263902 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:10.263569    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:40:12.263552622 +0000 UTC m=+252.311280596 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : secret "metrics-daemon-secret" not found
Jul 25 00:38:37.887755 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:37.887707    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h9kmd" podUID="1eddaf8e-1986-4e84-8418-1f45a95379f5"
Jul 25 00:38:38.075317 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:38:38.075286    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:38:38.543259 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:38.543216    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:38:42.779477 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:38:42.779442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:38:42.779956 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:42.779548    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 25 00:38:42.779956 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:38:42.779600    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls podName:1eddaf8e-1986-4e84-8418-1f45a95379f5 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:44.779586867 +0000 UTC m=+284.827314840 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls") pod "dns-default-h9kmd" (UID: "1eddaf8e-1986-4e84-8418-1f45a95379f5") : secret "dns-default-metrics-tls" not found
Jul 25 00:38:49.516613 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:38:49.516573    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:39:27.199792 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:39:27.199758    2574 generic.go:356] "Generic (PLEG): container finished" podID="523ac0cb-b62e-46e5-9bbd-8b23becfde91" containerID="653fcad3bda2aa666dc215c6cedefca8c7b1ba155613fa7c55acb24c75a37951" exitCode=255
Jul 25 00:39:27.200228 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:39:27.199824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7" event={"ID":"523ac0cb-b62e-46e5-9bbd-8b23becfde91","Type":"ContainerDied","Data":"653fcad3bda2aa666dc215c6cedefca8c7b1ba155613fa7c55acb24c75a37951"}
Jul 25 00:39:27.205173 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:39:27.205153    2574 scope.go:117] "RemoveContainer" containerID="653fcad3bda2aa666dc215c6cedefca8c7b1ba155613fa7c55acb24c75a37951"
Jul 25 00:39:28.204332 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:39:28.204293    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fcdc6d6-pklr7" event={"ID":"523ac0cb-b62e-46e5-9bbd-8b23becfde91","Type":"ContainerStarted","Data":"68f6b146e8831521f7b66e97acd7aeee0156693920420eda847c250a58593833"}
Jul 25 00:40:08.427614 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.427578    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:40:08.430563 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.430541    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.434117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.434090    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5x988\""
Jul 25 00:40:08.434117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.434112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 25 00:40:08.434291 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.434120    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 25 00:40:08.434291 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.434209    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 25 00:40:08.443176 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.443146    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 25 00:40:08.450675 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.450652    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:40:08.515215 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.515181    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"]
Jul 25 00:40:08.518095 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.518051    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"
Jul 25 00:40:08.520480 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.520457    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-spqtb\""
Jul 25 00:40:08.520861 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.520845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 25 00:40:08.520861 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.520859    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 25 00:40:08.521761 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.521745    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"]
Jul 25 00:40:08.524787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.524660    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"]
Jul 25 00:40:08.525417 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.525398    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"
Jul 25 00:40:08.527407 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.527385    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4db2\""
Jul 25 00:40:08.527649 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.527629    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"]
Jul 25 00:40:08.527802 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.527784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.530095 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.530074    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 25 00:40:08.530234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.530101    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 25 00:40:08.530234 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.530081    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 25 00:40:08.530440 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.530242    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2fdkv\""
Jul 25 00:40:08.531835 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.531815    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"]
Jul 25 00:40:08.534736 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.534717    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"]
Jul 25 00:40:08.548397 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548517 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548517 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548517 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548475    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548546    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbx92\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.548638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.548608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.649848 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649816    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649865    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlgmg\" (UniqueName: \"kubernetes.io/projected/483dfd81-c3aa-4fff-af84-9c96b6b3fa3d-kube-api-access-tlgmg\") pod \"network-check-source-7d88cb55d8-khdsb\" (UID: \"483dfd81-c3aa-4fff-af84-9c96b6b3fa3d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649893    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w249\" (UniqueName: \"kubernetes.io/projected/61a3da3a-dcb9-4a97-ad68-041e08391127-kube-api-access-7w249\") pod \"volume-data-source-validator-549c6d54cf-l8pbw\" (UID: \"61a3da3a-dcb9-4a97-ad68-041e08391127\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649916    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6bk\" (UniqueName: \"kubernetes.io/projected/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-kube-api-access-6m6bk\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.649959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650121    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbx92\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650143    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650166    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:08.650254    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:08.650269    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4488f6c-6bvkl: secret "image-registry-tls" not found
Jul 25 00:40:08.650383 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:08.650339    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls podName:26c02f23-da30-466b-9409-536e165520c0 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:09.150319034 +0000 UTC m=+249.198047024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls") pod "image-registry-74d4488f6c-6bvkl" (UID: "26c02f23-da30-466b-9409-536e165520c0") : secret "image-registry-tls" not found
Jul 25 00:40:08.650765 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650413    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.650765 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.650678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.651083 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.651047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.652393 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.652371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.652473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.652463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.657629 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.657610    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbx92\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.657805 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.657787    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:08.751299 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.751265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.751557 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.751327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlgmg\" (UniqueName: \"kubernetes.io/projected/483dfd81-c3aa-4fff-af84-9c96b6b3fa3d-kube-api-access-tlgmg\") pod \"network-check-source-7d88cb55d8-khdsb\" (UID: \"483dfd81-c3aa-4fff-af84-9c96b6b3fa3d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"
Jul 25 00:40:08.751557 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.751344    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w249\" (UniqueName: \"kubernetes.io/projected/61a3da3a-dcb9-4a97-ad68-041e08391127-kube-api-access-7w249\") pod \"volume-data-source-validator-549c6d54cf-l8pbw\" (UID: \"61a3da3a-dcb9-4a97-ad68-041e08391127\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"
Jul 25 00:40:08.751557 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.751364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6bk\" (UniqueName: \"kubernetes.io/projected/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-kube-api-access-6m6bk\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.751557 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:08.751410    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 25 00:40:08.751557 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:08.751500    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls podName:af81be52-a1bb-4c4c-94ee-4fa1c6f2f080 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:09.251481319 +0000 UTC m=+249.299209292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6492" (UID: "af81be52-a1bb-4c4c-94ee-4fa1c6f2f080") : secret "samples-operator-tls" not found
Jul 25 00:40:08.759102 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.759080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6bk\" (UniqueName: \"kubernetes.io/projected/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-kube-api-access-6m6bk\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:08.759201 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.759080    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlgmg\" (UniqueName: \"kubernetes.io/projected/483dfd81-c3aa-4fff-af84-9c96b6b3fa3d-kube-api-access-tlgmg\") pod \"network-check-source-7d88cb55d8-khdsb\" (UID: \"483dfd81-c3aa-4fff-af84-9c96b6b3fa3d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"
Jul 25 00:40:08.759201 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.759106    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w249\" (UniqueName: \"kubernetes.io/projected/61a3da3a-dcb9-4a97-ad68-041e08391127-kube-api-access-7w249\") pod \"volume-data-source-validator-549c6d54cf-l8pbw\" (UID: \"61a3da3a-dcb9-4a97-ad68-041e08391127\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"
Jul 25 00:40:08.827733 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.827697    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"
Jul 25 00:40:08.838982 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.838959    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"
Jul 25 00:40:08.955718 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.955684    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw"]
Jul 25 00:40:08.959833 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:08.959808    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a3da3a_dcb9_4a97_ad68_041e08391127.slice/crio-9dc68dc5ee1c7dd82ee70cb687e4defe6d22b51ab6b3d339fe7c8dc3417d0139 WatchSource:0}: Error finding container 9dc68dc5ee1c7dd82ee70cb687e4defe6d22b51ab6b3d339fe7c8dc3417d0139: Status 404 returned error can't find the container with id 9dc68dc5ee1c7dd82ee70cb687e4defe6d22b51ab6b3d339fe7c8dc3417d0139
Jul 25 00:40:08.973444 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:08.973420    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb"]
Jul 25 00:40:08.976452 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:08.976428    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483dfd81_c3aa_4fff_af84_9c96b6b3fa3d.slice/crio-c3e9f8e75aeed1858ee6d5a927f074aeafe5722e5d373274699719a08ac3eceb WatchSource:0}: Error finding container c3e9f8e75aeed1858ee6d5a927f074aeafe5722e5d373274699719a08ac3eceb: Status 404 returned error can't find the container with id c3e9f8e75aeed1858ee6d5a927f074aeafe5722e5d373274699719a08ac3eceb
Jul 25 00:40:09.155339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.155297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:09.155509 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:09.155479    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 25 00:40:09.155509 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:09.155504    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4488f6c-6bvkl: secret "image-registry-tls" not found
Jul 25 00:40:09.155586 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:09.155569    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls podName:26c02f23-da30-466b-9409-536e165520c0 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:10.155549705 +0000 UTC m=+250.203277692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls") pod "image-registry-74d4488f6c-6bvkl" (UID: "26c02f23-da30-466b-9409-536e165520c0") : secret "image-registry-tls" not found
Jul 25 00:40:09.256074 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.256032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:09.256215 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:09.256183    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 25 00:40:09.256261 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:09.256246    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls podName:af81be52-a1bb-4c4c-94ee-4fa1c6f2f080 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:10.256232255 +0000 UTC m=+250.303960227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6492" (UID: "af81be52-a1bb-4c4c-94ee-4fa1c6f2f080") : secret "samples-operator-tls" not found
Jul 25 00:40:09.304449 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.304364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb" event={"ID":"483dfd81-c3aa-4fff-af84-9c96b6b3fa3d","Type":"ContainerStarted","Data":"766e12b27b3b2dc3c2c965e696ee08324bb32f8a0e2ec2f869fceb80f1745f35"}
Jul 25 00:40:09.304449 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.304425    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb" event={"ID":"483dfd81-c3aa-4fff-af84-9c96b6b3fa3d","Type":"ContainerStarted","Data":"c3e9f8e75aeed1858ee6d5a927f074aeafe5722e5d373274699719a08ac3eceb"}
Jul 25 00:40:09.305431 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.305406    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw" event={"ID":"61a3da3a-dcb9-4a97-ad68-041e08391127","Type":"ContainerStarted","Data":"9dc68dc5ee1c7dd82ee70cb687e4defe6d22b51ab6b3d339fe7c8dc3417d0139"}
Jul 25 00:40:09.317888 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:09.317849    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-khdsb" podStartSLOduration=1.317836454 podStartE2EDuration="1.317836454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:09.31700139 +0000 UTC m=+249.364729385" watchObservedRunningTime="2026-07-25 00:40:09.317836454 +0000 UTC m=+249.365564451"
Jul 25 00:40:10.162339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:10.162313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:10.162627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:10.162478    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 25 00:40:10.162627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:10.162497    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4488f6c-6bvkl: secret "image-registry-tls" not found
Jul 25 00:40:10.162627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:10.162557    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls podName:26c02f23-da30-466b-9409-536e165520c0 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:12.162541088 +0000 UTC m=+252.210269075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls") pod "image-registry-74d4488f6c-6bvkl" (UID: "26c02f23-da30-466b-9409-536e165520c0") : secret "image-registry-tls" not found
Jul 25 00:40:10.263565 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:10.263530    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:10.263743 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:10.263644    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 25 00:40:10.263743 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:10.263703    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls podName:af81be52-a1bb-4c4c-94ee-4fa1c6f2f080 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:12.263686432 +0000 UTC m=+252.311414413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6492" (UID: "af81be52-a1bb-4c4c-94ee-4fa1c6f2f080") : secret "samples-operator-tls" not found
Jul 25 00:40:10.313731 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:10.313696    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw" event={"ID":"61a3da3a-dcb9-4a97-ad68-041e08391127","Type":"ContainerStarted","Data":"ae63bcf54f1c7f9c28ec78693d01220943251714506e1e53c08faa61451a0f70"}
Jul 25 00:40:10.329500 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:10.329452    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-l8pbw" podStartSLOduration=1.187328474 podStartE2EDuration="2.329434249s" totalImagesPullingTime="1.142105775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:10.32869274 +0000 UTC m=+250.376420734" watchObservedRunningTime="2026-07-25 00:40:10.329434249 +0000 UTC m=+250.377162245"
Jul 25 00:40:12.178343 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:12.178307    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:12.178730 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.178454    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 25 00:40:12.178730 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.178473    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4488f6c-6bvkl: secret "image-registry-tls" not found
Jul 25 00:40:12.178730 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.178532    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls podName:26c02f23-da30-466b-9409-536e165520c0 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:16.178516954 +0000 UTC m=+256.226244930 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls") pod "image-registry-74d4488f6c-6bvkl" (UID: "26c02f23-da30-466b-9409-536e165520c0") : secret "image-registry-tls" not found
Jul 25 00:40:12.278943 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:12.278910    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:12.278943 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:12.278947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:40:12.279159 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.279045    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 25 00:40:12.279159 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.279096    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 25 00:40:12.279159 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.279120    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs podName:cf10a4aa-bf28-4187-b2cd-8e911b7941fd nodeName:}" failed. No retries permitted until 2026-07-25 00:42:14.279103945 +0000 UTC m=+374.326831918 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs") pod "network-metrics-daemon-2s69q" (UID: "cf10a4aa-bf28-4187-b2cd-8e911b7941fd") : secret "metrics-daemon-secret" not found
Jul 25 00:40:12.279278 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:12.279167    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls podName:af81be52-a1bb-4c4c-94ee-4fa1c6f2f080 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:16.279149018 +0000 UTC m=+256.326876994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6492" (UID: "af81be52-a1bb-4c4c-94ee-4fa1c6f2f080") : secret "samples-operator-tls" not found
Jul 25 00:40:13.212530 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.212495    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"]
Jul 25 00:40:13.215579 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.215563    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"
Jul 25 00:40:13.217872 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.217845    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 25 00:40:13.217992 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.217846    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 25 00:40:13.218610 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.218591    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qmns7\""
Jul 25 00:40:13.222009 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.221987    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"]
Jul 25 00:40:13.386857 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.386822    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v79ls\" (UniqueName: \"kubernetes.io/projected/f38d19ab-d09c-4bc9-9800-39f7e9f8c97a-kube-api-access-v79ls\") pod \"migrator-6865c9967-l642q\" (UID: \"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"
Jul 25 00:40:13.487854 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.487790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v79ls\" (UniqueName: \"kubernetes.io/projected/f38d19ab-d09c-4bc9-9800-39f7e9f8c97a-kube-api-access-v79ls\") pod \"migrator-6865c9967-l642q\" (UID: \"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"
Jul 25 00:40:13.495589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.495559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v79ls\" (UniqueName: \"kubernetes.io/projected/f38d19ab-d09c-4bc9-9800-39f7e9f8c97a-kube-api-access-v79ls\") pod \"migrator-6865c9967-l642q\" (UID: \"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"
Jul 25 00:40:13.524975 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.524954    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"
Jul 25 00:40:13.644125 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:13.644093    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-l642q"]
Jul 25 00:40:13.646751 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:13.646724    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38d19ab_d09c_4bc9_9800_39f7e9f8c97a.slice/crio-8e37a959bc6e9092670444c52b2fd22740cac1ae51904f484398e8157c5fcbe6 WatchSource:0}: Error finding container 8e37a959bc6e9092670444c52b2fd22740cac1ae51904f484398e8157c5fcbe6: Status 404 returned error can't find the container with id 8e37a959bc6e9092670444c52b2fd22740cac1ae51904f484398e8157c5fcbe6
Jul 25 00:40:14.239152 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.239117    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-88zz5"]
Jul 25 00:40:14.242359 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.242337    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.244617 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.244593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 25 00:40:14.245522 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.245493    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6x25j\""
Jul 25 00:40:14.245604 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.245528    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 25 00:40:14.245668 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.245530    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 25 00:40:14.245845 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.245822    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 25 00:40:14.256363 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.256314    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88zz5"]
Jul 25 00:40:14.326686 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.326649    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q" event={"ID":"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a","Type":"ContainerStarted","Data":"8e37a959bc6e9092670444c52b2fd22740cac1ae51904f484398e8157c5fcbe6"}
Jul 25 00:40:14.395247 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.395206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91f55ebd-21ea-4445-abf8-36ae440afea4-data-volume\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.395247 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.395247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.395457 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.395263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.395457 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.395355    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91f55ebd-21ea-4445-abf8-36ae440afea4-crio-socket\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.395457 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.395380    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqrs\" (UniqueName: \"kubernetes.io/projected/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-api-access-vlqrs\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.495773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.495698    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91f55ebd-21ea-4445-abf8-36ae440afea4-data-volume\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.495773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.495734    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.495773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.495754    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.496021 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:14.495829    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 00:40:14.496021 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:14.495841    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:14.496021 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:14.495912    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:14.995895625 +0000 UTC m=+255.043623601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : configmap "kube-rbac-proxy" not found
Jul 25 00:40:14.496021 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:14.495938    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:14.995931591 +0000 UTC m=+255.043659564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:14.496021 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.495996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91f55ebd-21ea-4445-abf8-36ae440afea4-crio-socket\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.496217 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.496027    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqrs\" (UniqueName: \"kubernetes.io/projected/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-api-access-vlqrs\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.496217 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.496030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91f55ebd-21ea-4445-abf8-36ae440afea4-data-volume\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.496217 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.496123    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91f55ebd-21ea-4445-abf8-36ae440afea4-crio-socket\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:14.503606 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:14.503588    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqrs\" (UniqueName: \"kubernetes.io/projected/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-api-access-vlqrs\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:15.000460 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:15.000423    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:15.000646 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:15.000466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:15.000646 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:15.000555    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 00:40:15.000646 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:15.000574    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:15.000646 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:15.000636    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:16.00061578 +0000 UTC m=+256.048343774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : configmap "kube-rbac-proxy" not found
Jul 25 00:40:15.000866 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:15.000655    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:16.000646544 +0000 UTC m=+256.048374532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:16.007938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.007902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:16.007938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.007937    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:16.008412 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.008016    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 00:40:16.008412 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.008035    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:16.008412 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.008111    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:18.00809249 +0000 UTC m=+258.055820465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : configmap "kube-rbac-proxy" not found
Jul 25 00:40:16.008412 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.008172    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:18.008155906 +0000 UTC m=+258.055883897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:16.210266 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.210234    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:16.210423 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.210371    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 25 00:40:16.210423 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.210385    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4488f6c-6bvkl: secret "image-registry-tls" not found
Jul 25 00:40:16.210494 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.210430    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls podName:26c02f23-da30-466b-9409-536e165520c0 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:24.210416025 +0000 UTC m=+264.258143999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls") pod "image-registry-74d4488f6c-6bvkl" (UID: "26c02f23-da30-466b-9409-536e165520c0") : secret "image-registry-tls" not found
Jul 25 00:40:16.311336 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.311265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:16.311459 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.311403    2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 25 00:40:16.311496 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:16.311460    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls podName:af81be52-a1bb-4c4c-94ee-4fa1c6f2f080 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:24.311445004 +0000 UTC m=+264.359172981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls") pod "cluster-samples-operator-6748489656-m6492" (UID: "af81be52-a1bb-4c4c-94ee-4fa1c6f2f080") : secret "samples-operator-tls" not found
Jul 25 00:40:16.336274 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.336240    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q" event={"ID":"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a","Type":"ContainerStarted","Data":"e7aa1b1ac707771b0a3a3e94f5feb0cc0a98b6b4c181e95996bebe4008416fe3"}
Jul 25 00:40:16.336441 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.336290    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q" event={"ID":"f38d19ab-d09c-4bc9-9800-39f7e9f8c97a","Type":"ContainerStarted","Data":"f5830d86b7238940126f3197bd300b522c2046a3018daf33d9dc8a04a2ef5972"}
Jul 25 00:40:16.349811 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.349768    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-l642q" podStartSLOduration=1.65411012 podStartE2EDuration="3.34975276s" totalImagesPullingTime="1.69564264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:16.349079355 +0000 UTC m=+256.396807343" watchObservedRunningTime="2026-07-25 00:40:16.34975276 +0000 UTC m=+256.397480754"
Jul 25 00:40:16.820802 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:16.820776    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9f4fv_ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1/dns-node-resolver/0.log"
Jul 25 00:40:18.021452 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:18.021422    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncbs8_45bad3a3-8404-4ff1-a97b-a59685573ea3/node-ca/0.log"
Jul 25 00:40:18.025687 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:18.025668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:18.025753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:18.025695    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:18.025793 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:18.025773    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 00:40:18.025835 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:18.025825    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:22.02581108 +0000 UTC m=+262.073539052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : configmap "kube-rbac-proxy" not found
Jul 25 00:40:18.025879 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:18.025846    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:18.025911 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:18.025892    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:22.025878082 +0000 UTC m=+262.073606071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:18.821906 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:18.821878    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jthmf_c13a777b-c88c-4114-bf41-ab5d5a7c203d/serve-healthcheck-canary/0.log"
Jul 25 00:40:19.221913 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:19.221888    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-l642q_f38d19ab-d09c-4bc9-9800-39f7e9f8c97a/migrator/0.log"
Jul 25 00:40:19.422529 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:19.422493    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-l642q_f38d19ab-d09c-4bc9-9800-39f7e9f8c97a/graceful-termination/0.log"
Jul 25 00:40:22.055914 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:22.055840    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:22.055914 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:22.055874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:22.056324 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:22.055955    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 25 00:40:22.056324 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:22.056007    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:22.056324 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:22.056025    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:30.056009015 +0000 UTC m=+270.103736987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : configmap "kube-rbac-proxy" not found
Jul 25 00:40:22.056324 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:22.056078    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls podName:91f55ebd-21ea-4445-abf8-36ae440afea4 nodeName:}" failed. No retries permitted until 2026-07-25 00:40:30.056049477 +0000 UTC m=+270.103777453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-88zz5" (UID: "91f55ebd-21ea-4445-abf8-36ae440afea4") : secret "insights-runtime-extractor-tls" not found
Jul 25 00:40:24.272976 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.272941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:24.275284 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.275263    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"image-registry-74d4488f6c-6bvkl\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") " pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:24.340571 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.340531    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:24.373941 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.373911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:24.377226 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.377197    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/af81be52-a1bb-4c4c-94ee-4fa1c6f2f080-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-m6492\" (UID: \"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:24.443348 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.443311    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"
Jul 25 00:40:24.460501 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.460476    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:40:24.463949 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:24.463922    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c02f23_da30_466b_9409_536e165520c0.slice/crio-bc5f81ca3d203eed72eeec2455b0eec183f911e230c674792e42700fa755fd5e WatchSource:0}: Error finding container bc5f81ca3d203eed72eeec2455b0eec183f911e230c674792e42700fa755fd5e: Status 404 returned error can't find the container with id bc5f81ca3d203eed72eeec2455b0eec183f911e230c674792e42700fa755fd5e
Jul 25 00:40:24.573363 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:24.573330    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492"]
Jul 25 00:40:25.362020 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:25.361977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492" event={"ID":"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080","Type":"ContainerStarted","Data":"9bab637cbd9ece6b20a93376cdd087f025a7b690eb2e638397f4b2ecf289d047"}
Jul 25 00:40:25.363665 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:25.363630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" event={"ID":"26c02f23-da30-466b-9409-536e165520c0","Type":"ContainerStarted","Data":"9fe5dd614ebc3ae141ccd07941a36c2df839e9b54575e90bf735a6edddacb550"}
Jul 25 00:40:25.363800 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:25.363678    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" event={"ID":"26c02f23-da30-466b-9409-536e165520c0","Type":"ContainerStarted","Data":"bc5f81ca3d203eed72eeec2455b0eec183f911e230c674792e42700fa755fd5e"}
Jul 25 00:40:25.363800 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:25.363788    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:25.382763 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:25.382716    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" podStartSLOduration=17.382696212 podStartE2EDuration="17.382696212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:25.380884111 +0000 UTC m=+265.428612106" watchObservedRunningTime="2026-07-25 00:40:25.382696212 +0000 UTC m=+265.430424209"
Jul 25 00:40:26.368509 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:26.368472    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492" event={"ID":"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080","Type":"ContainerStarted","Data":"7eaf7cbec355395800d6b1603e4a226e10e65e1071ffc756f4087ee90ad78666"}
Jul 25 00:40:26.368938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:26.368534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492" event={"ID":"af81be52-a1bb-4c4c-94ee-4fa1c6f2f080","Type":"ContainerStarted","Data":"cbe14e40aa62e6198bf0a9407b0987b43530bb62455ce05d2b156652f1e1547f"}
Jul 25 00:40:26.382478 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:26.382429    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-m6492" podStartSLOduration=16.790203532 podStartE2EDuration="18.382414637s" totalImagesPullingTime="1.592211105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:26.382206339 +0000 UTC m=+266.429934332" watchObservedRunningTime="2026-07-25 00:40:26.382414637 +0000 UTC m=+266.430142632"
Jul 25 00:40:30.129277 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.129236    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:30.129277 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.129275    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:30.129916 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.129890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91f55ebd-21ea-4445-abf8-36ae440afea4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:30.131484 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.131466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91f55ebd-21ea-4445-abf8-36ae440afea4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-88zz5\" (UID: \"91f55ebd-21ea-4445-abf8-36ae440afea4\") " pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:30.152477 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.152453    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-88zz5"
Jul 25 00:40:30.272600 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.272570    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-88zz5"]
Jul 25 00:40:30.275761 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:30.275729    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91f55ebd_21ea_4445_abf8_36ae440afea4.slice/crio-a201fb8c5600ffd79b47a60ddc18eac11f8830088d6352f8b83be454efe18a35 WatchSource:0}: Error finding container a201fb8c5600ffd79b47a60ddc18eac11f8830088d6352f8b83be454efe18a35: Status 404 returned error can't find the container with id a201fb8c5600ffd79b47a60ddc18eac11f8830088d6352f8b83be454efe18a35
Jul 25 00:40:30.381703 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:30.381619    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88zz5" event={"ID":"91f55ebd-21ea-4445-abf8-36ae440afea4","Type":"ContainerStarted","Data":"a201fb8c5600ffd79b47a60ddc18eac11f8830088d6352f8b83be454efe18a35"}
Jul 25 00:40:34.321097 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.321038    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:40:34.339100 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.339069    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c84484f9c-kdtpp"]
Jul 25 00:40:34.376217 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.376175    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c84484f9c-kdtpp"]
Jul 25 00:40:34.376362 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.376312    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.462900 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.462866    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-certificates\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.462900 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.462901    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-tls\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.462992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-installation-pull-secrets\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.463047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-image-registry-private-configuration\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.463129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18389799-e3c3-44c5-bd06-d57b20aaab38-ca-trust-extracted\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463178 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.463155    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-trusted-ca\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463388 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.463192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsnj5\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-kube-api-access-xsnj5\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.463388 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.463221    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-bound-sa-token\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564068 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564017    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-certificates\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564222 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564160    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-tls\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564222 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-installation-pull-secrets\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564318 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564226    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-image-registry-private-configuration\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564318 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18389799-e3c3-44c5-bd06-d57b20aaab38-ca-trust-extracted\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564318 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-trusted-ca\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsnj5\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-kube-api-access-xsnj5\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-bound-sa-token\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564828 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/18389799-e3c3-44c5-bd06-d57b20aaab38-ca-trust-extracted\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.564943 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.564878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-certificates\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.565434 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.565348    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/18389799-e3c3-44c5-bd06-d57b20aaab38-trusted-ca\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.567086 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.567049    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-registry-tls\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.567219 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.567193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-installation-pull-secrets\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.567402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.567385    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/18389799-e3c3-44c5-bd06-d57b20aaab38-image-registry-private-configuration\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.574078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.574004    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsnj5\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-kube-api-access-xsnj5\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.574313 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.574296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/18389799-e3c3-44c5-bd06-d57b20aaab38-bound-sa-token\") pod \"image-registry-6c84484f9c-kdtpp\" (UID: \"18389799-e3c3-44c5-bd06-d57b20aaab38\") " pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:34.687190 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:34.687156    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:35.183962 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.183929    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c84484f9c-kdtpp"]
Jul 25 00:40:35.187128 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:35.187096    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18389799_e3c3_44c5_bd06_d57b20aaab38.slice/crio-ed25fdf6bd4cf75dd048a2459588da083bfc0d52d54ce5d98b38f7d86b959f59 WatchSource:0}: Error finding container ed25fdf6bd4cf75dd048a2459588da083bfc0d52d54ce5d98b38f7d86b959f59: Status 404 returned error can't find the container with id ed25fdf6bd4cf75dd048a2459588da083bfc0d52d54ce5d98b38f7d86b959f59
Jul 25 00:40:35.400858 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.400767    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88zz5" event={"ID":"91f55ebd-21ea-4445-abf8-36ae440afea4","Type":"ContainerStarted","Data":"0fadcd01b85007c2d6749cbf7fbd271e49b70322bd19190dc210f7a8e8104725"}
Jul 25 00:40:35.402183 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.402162    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp" event={"ID":"18389799-e3c3-44c5-bd06-d57b20aaab38","Type":"ContainerStarted","Data":"633c73e74af15daa383c5bca3b4072bbf51970861cc5c5eedc216ee301d6d7bb"}
Jul 25 00:40:35.402296 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.402198    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp" event={"ID":"18389799-e3c3-44c5-bd06-d57b20aaab38","Type":"ContainerStarted","Data":"ed25fdf6bd4cf75dd048a2459588da083bfc0d52d54ce5d98b38f7d86b959f59"}
Jul 25 00:40:35.402296 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.402287    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:35.421656 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:35.421611    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp" podStartSLOduration=1.421595937 podStartE2EDuration="1.421595937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:35.420472515 +0000 UTC m=+275.468200509" watchObservedRunningTime="2026-07-25 00:40:35.421595937 +0000 UTC m=+275.469323932"
Jul 25 00:40:39.417571 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:39.417525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88zz5" event={"ID":"91f55ebd-21ea-4445-abf8-36ae440afea4","Type":"ContainerStarted","Data":"2fdb5bb9e23dd66271f675d76d636d0559dd39505a6c831111211789f81dea58"}
Jul 25 00:40:41.076637 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:41.076597    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-h9kmd" podUID="1eddaf8e-1986-4e84-8418-1f45a95379f5"
Jul 25 00:40:41.423962 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:41.423882    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:42.428813 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:42.428779    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-88zz5" event={"ID":"91f55ebd-21ea-4445-abf8-36ae440afea4","Type":"ContainerStarted","Data":"161c06abc321a87a307c24b12ddf704deda865fc365478c1d97c86b923955f76"}
Jul 25 00:40:42.445140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:42.445089    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-88zz5" podStartSLOduration=16.994206802 podStartE2EDuration="28.445074244s" totalImagesPullingTime="11.450867442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 00:40:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:42.444041126 +0000 UTC m=+282.491769134" watchObservedRunningTime="2026-07-25 00:40:42.445074244 +0000 UTC m=+282.492802233"
Jul 25 00:40:44.326610 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:44.326576    2574 patch_prober.go:28] interesting pod/image-registry-74d4488f6c-6bvkl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 25 00:40:44.327034 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:44.326632    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 00:40:44.851291 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:44.851238    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:44.853594 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:44.853569    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1eddaf8e-1986-4e84-8418-1f45a95379f5-metrics-tls\") pod \"dns-default-h9kmd\" (UID: \"1eddaf8e-1986-4e84-8418-1f45a95379f5\") " pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:45.027277 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:45.027243    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2m9l\""
Jul 25 00:40:45.035955 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:45.035932    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:45.160938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:45.160907    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h9kmd"]
Jul 25 00:40:45.163713 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:45.163687    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eddaf8e_1986_4e84_8418_1f45a95379f5.slice/crio-a415a06b3299eaa9132147899abfc12b22bd6b171a7384a157518d248f3061cd WatchSource:0}: Error finding container a415a06b3299eaa9132147899abfc12b22bd6b171a7384a157518d248f3061cd: Status 404 returned error can't find the container with id a415a06b3299eaa9132147899abfc12b22bd6b171a7384a157518d248f3061cd
Jul 25 00:40:45.439473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:45.439392    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9kmd" event={"ID":"1eddaf8e-1986-4e84-8418-1f45a95379f5","Type":"ContainerStarted","Data":"a415a06b3299eaa9132147899abfc12b22bd6b171a7384a157518d248f3061cd"}
Jul 25 00:40:46.660863 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.660828    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:40:46.663736 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.663719    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.665662 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.665642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 25 00:40:46.665779 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.665668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 25 00:40:46.665779 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.665692    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m6m2t\""
Jul 25 00:40:46.666535 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.666516    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 25 00:40:46.666652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.666523    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 25 00:40:46.666652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.666592    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 25 00:40:46.666652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.666632    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 25 00:40:46.666817 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.666660    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 25 00:40:46.673723 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.673702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:40:46.767749 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767719    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.767853 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767754    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.767853 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7vr\" (UniqueName: \"kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.767853 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767817    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.767853 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.768026 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.767931    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.868849 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.868820    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869014 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.868881    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869014 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.868914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869014 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.868941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869014 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.868967    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7vr\" (UniqueName: \"kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869243 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.869124    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869653 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.869628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869757 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.869628    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.869757 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.869704    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.871359 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.871339    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.871451 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.871435    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.878924 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.878898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7vr\" (UniqueName: \"kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr\") pod \"console-75c6d68fb9-87fdb\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") " pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:46.973675 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:46.973640    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:47.096198 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.096165    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:40:47.099652 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:47.099626    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8781304f_70b3_4518_adc6_cdaf637364a4.slice/crio-067530ab0b7bb82b60afb95882a2e2b82c40c910429b684a715951bf49fc7665 WatchSource:0}: Error finding container 067530ab0b7bb82b60afb95882a2e2b82c40c910429b684a715951bf49fc7665: Status 404 returned error can't find the container with id 067530ab0b7bb82b60afb95882a2e2b82c40c910429b684a715951bf49fc7665
Jul 25 00:40:47.447458 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.447369    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9kmd" event={"ID":"1eddaf8e-1986-4e84-8418-1f45a95379f5","Type":"ContainerStarted","Data":"ddc6919870dfcb0c59b915d4596dc2f559b676d3caa1c6b6a28e953d80210cb1"}
Jul 25 00:40:47.447458 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.447438    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h9kmd" event={"ID":"1eddaf8e-1986-4e84-8418-1f45a95379f5","Type":"ContainerStarted","Data":"9e97b6ea67fba1194fba3af71132e039f7ad8c2d1b3946e769d3ab7f2dc09aac"}
Jul 25 00:40:47.447682 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.447469    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:47.448501 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.448478    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c6d68fb9-87fdb" event={"ID":"8781304f-70b3-4518-adc6-cdaf637364a4","Type":"ContainerStarted","Data":"067530ab0b7bb82b60afb95882a2e2b82c40c910429b684a715951bf49fc7665"}
Jul 25 00:40:47.462415 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:47.462369    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h9kmd" podStartSLOduration=251.954121042 podStartE2EDuration="4m13.462350899s" totalImagesPullingTime="1.508229857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:47.4616089 +0000 UTC m=+287.509336909" watchObservedRunningTime="2026-07-25 00:40:47.462350899 +0000 UTC m=+287.510078895"
Jul 25 00:40:48.371394 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.371358    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"]
Jul 25 00:40:48.374312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.374296    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.376633 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.376611    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b8ptf\""
Jul 25 00:40:48.376755 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.376613    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 25 00:40:48.377418 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.377394    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 25 00:40:48.377536 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.377434    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 25 00:40:48.377536 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.377396    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 25 00:40:48.377536 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.377406    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 25 00:40:48.382236 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.382215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"]
Jul 25 00:40:48.484387 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.484354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.484568 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.484419    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a26cb0a-1f72-43fe-83a6-677193af097b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.484568 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.484492    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.484568 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.484550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnv47\" (UniqueName: \"kubernetes.io/projected/6a26cb0a-1f72-43fe-83a6-677193af097b-kube-api-access-cnv47\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.585802 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.585771    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.585954 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.585907    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnv47\" (UniqueName: \"kubernetes.io/projected/6a26cb0a-1f72-43fe-83a6-677193af097b-kube-api-access-cnv47\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.586029 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.586010    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.586135 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.586115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a26cb0a-1f72-43fe-83a6-677193af097b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.586824 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.586799    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a26cb0a-1f72-43fe-83a6-677193af097b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.588594 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.588571    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.588693 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.588593    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a26cb0a-1f72-43fe-83a6-677193af097b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.593233 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.593211    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnv47\" (UniqueName: \"kubernetes.io/projected/6a26cb0a-1f72-43fe-83a6-677193af097b-kube-api-access-cnv47\") pod \"prometheus-operator-84d69f794d-zlkxk\" (UID: \"6a26cb0a-1f72-43fe-83a6-677193af097b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.684132 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.684038    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"
Jul 25 00:40:48.813707 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:48.813679    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-zlkxk"]
Jul 25 00:40:48.816181 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:48.816146    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a26cb0a_1f72_43fe_83a6_677193af097b.slice/crio-ea1cec6d44eab2404cc7ff84063ae71c837137d55fa4c1ed67b232ec0265b4eb WatchSource:0}: Error finding container ea1cec6d44eab2404cc7ff84063ae71c837137d55fa4c1ed67b232ec0265b4eb: Status 404 returned error can't find the container with id ea1cec6d44eab2404cc7ff84063ae71c837137d55fa4c1ed67b232ec0265b4eb
Jul 25 00:40:49.458087 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:49.458032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk" event={"ID":"6a26cb0a-1f72-43fe-83a6-677193af097b","Type":"ContainerStarted","Data":"ea1cec6d44eab2404cc7ff84063ae71c837137d55fa4c1ed67b232ec0265b4eb"}
Jul 25 00:40:51.466141 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:51.466099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk" event={"ID":"6a26cb0a-1f72-43fe-83a6-677193af097b","Type":"ContainerStarted","Data":"20ecc87fafc8abda0c3d5f399270318128a675ac336f5a7c5a0fe188692c92fc"}
Jul 25 00:40:51.466556 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:51.466167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk" event={"ID":"6a26cb0a-1f72-43fe-83a6-677193af097b","Type":"ContainerStarted","Data":"1668875b3728a1a717ad1d2b10c42c44f5715fcfba23a882e758507cf8f856c2"}
Jul 25 00:40:51.467638 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:51.467618    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c6d68fb9-87fdb" event={"ID":"8781304f-70b3-4518-adc6-cdaf637364a4","Type":"ContainerStarted","Data":"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"}
Jul 25 00:40:51.481493 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:51.481454    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-zlkxk" podStartSLOduration=1.5465195139999999 podStartE2EDuration="3.481440861s" totalImagesPullingTime="1.934921347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:51.480611344 +0000 UTC m=+291.528339351" watchObservedRunningTime="2026-07-25 00:40:51.481440861 +0000 UTC m=+291.529168847"
Jul 25 00:40:51.495113 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:51.495049    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75c6d68fb9-87fdb" podStartSLOduration=1.838865648 podStartE2EDuration="5.495036457s" totalImagesPullingTime="3.656170809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:51.494461082 +0000 UTC m=+291.542189077" watchObservedRunningTime="2026-07-25 00:40:51.495036457 +0000 UTC m=+291.542764452"
Jul 25 00:40:52.517555 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:40:52.517511    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2s69q" podUID="cf10a4aa-bf28-4187-b2cd-8e911b7941fd"
Jul 25 00:40:53.707909 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.707873    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2rl8q"]
Jul 25 00:40:53.710130 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.710113    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.712243 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.712221    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 25 00:40:53.712243 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.712240    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nql9s\""
Jul 25 00:40:53.712472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.712453    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 25 00:40:53.712515 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.712471    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 25 00:40:53.828647 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-wtmp\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828647 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828653    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-root\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828832 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828675    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828832 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828727    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmtj\" (UniqueName: \"kubernetes.io/projected/40ce7f04-89fd-4aed-afad-0c782664962e-kube-api-access-2bmtj\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828832 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828795    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-metrics-client-ca\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828832 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828824    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-textfile\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828863    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-tls\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.828991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.828882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-sys\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929605 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929569    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-root\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929605 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929646    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmtj\" (UniqueName: \"kubernetes.io/projected/40ce7f04-89fd-4aed-afad-0c782664962e-kube-api-access-2bmtj\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-metrics-client-ca\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-root\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929715    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-textfile\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929838    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.929871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-tls\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929898    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-sys\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.929945    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-wtmp\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.930034    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-sys\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.930053    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-textfile\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930338 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.930165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-wtmp\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930400 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.930377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-accelerators-collector-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.930440 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.930394    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40ce7f04-89fd-4aed-afad-0c782664962e-metrics-client-ca\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.932279 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.932254    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-tls\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.932401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.932288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40ce7f04-89fd-4aed-afad-0c782664962e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:53.938575 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:53.938556    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmtj\" (UniqueName: \"kubernetes.io/projected/40ce7f04-89fd-4aed-afad-0c782664962e-kube-api-access-2bmtj\") pod \"node-exporter-2rl8q\" (UID: \"40ce7f04-89fd-4aed-afad-0c782664962e\") " pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:54.019471 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.019365    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2rl8q"
Jul 25 00:40:54.029286 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:54.029257    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ce7f04_89fd_4aed_afad_0c782664962e.slice/crio-388f6be2e997df0234c2df53630add787e1e74eed5891a25bc31e22f4af2af0f WatchSource:0}: Error finding container 388f6be2e997df0234c2df53630add787e1e74eed5891a25bc31e22f4af2af0f: Status 404 returned error can't find the container with id 388f6be2e997df0234c2df53630add787e1e74eed5891a25bc31e22f4af2af0f
Jul 25 00:40:54.325824 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.325738    2574 patch_prober.go:28] interesting pod/image-registry-74d4488f6c-6bvkl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 25 00:40:54.325824 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.325791    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 00:40:54.478273 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.478236    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2rl8q" event={"ID":"40ce7f04-89fd-4aed-afad-0c782664962e","Type":"ContainerStarted","Data":"388f6be2e997df0234c2df53630add787e1e74eed5891a25bc31e22f4af2af0f"}
Jul 25 00:40:54.692777 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.692692    2574 patch_prober.go:28] interesting pod/image-registry-6c84484f9c-kdtpp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 25 00:40:54.692777 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:54.692750    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp" podUID="18389799-e3c3-44c5-bd06-d57b20aaab38" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 00:40:55.482519 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:55.482480    2574 generic.go:356] "Generic (PLEG): container finished" podID="40ce7f04-89fd-4aed-afad-0c782664962e" containerID="8181500656fc1e0b98a8fee492a62a47503872cb518eb90261e5650e6aa5eca8" exitCode=0
Jul 25 00:40:55.482910 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:55.482551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2rl8q" event={"ID":"40ce7f04-89fd-4aed-afad-0c782664962e","Type":"ContainerDied","Data":"8181500656fc1e0b98a8fee492a62a47503872cb518eb90261e5650e6aa5eca8"}
Jul 25 00:40:56.057079 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.057024    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:40:56.060255 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.060238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.067572 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.067551    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 25 00:40:56.069627 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.069608    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:40:56.146419 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8gp\" (UniqueName: \"kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146563 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146563 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146563 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146520    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146563 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146714 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.146714 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.146632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247203 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247168    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247203 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247205    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247270    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247314    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.247425 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8gp\" (UniqueName: \"kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.248021 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.247990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.248213 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.248114    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.248213 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.248147    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.248410 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.248389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.249695 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.249666    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.249768 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.249748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.254113 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.254097    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8gp\" (UniqueName: \"kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp\") pod \"console-56498c468c-fpsk4\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") " pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.370206 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.370124    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:40:56.410170 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.410144    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c84484f9c-kdtpp"
Jul 25 00:40:56.488538 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.488489    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2rl8q" event={"ID":"40ce7f04-89fd-4aed-afad-0c782664962e","Type":"ContainerStarted","Data":"9eb1daf4ece68f1f9772db0703c851f66a14c8fd0c584f32136c9b67ca67da9f"}
Jul 25 00:40:56.488972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.488561    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2rl8q" event={"ID":"40ce7f04-89fd-4aed-afad-0c782664962e","Type":"ContainerStarted","Data":"d5ecc400022807f86f6252a59667f19496f836017d38c87bead84687186351c8"}
Jul 25 00:40:56.514039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.514008    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:40:56.515250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.515153    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2rl8q" podStartSLOduration=2.483883763 podStartE2EDuration="3.515134467s" totalImagesPullingTime="967.580591ms" totalInitContainerRuntime="63.670113ms" isStatefulPod=true podCreationTimestamp="2026-07-25 00:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:56.514517715 +0000 UTC m=+296.562245713" watchObservedRunningTime="2026-07-25 00:40:56.515134467 +0000 UTC m=+296.562862463"
Jul 25 00:40:56.517426 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:40:56.517399    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode487fc4c_ba16_4672_8c1f_4a30c70b7a84.slice/crio-7b9ac78be6c45712ac86ceb37cb1e44261334b4d4e07819eec4fa01e65ad5509 WatchSource:0}: Error finding container 7b9ac78be6c45712ac86ceb37cb1e44261334b4d4e07819eec4fa01e65ad5509: Status 404 returned error can't find the container with id 7b9ac78be6c45712ac86ceb37cb1e44261334b4d4e07819eec4fa01e65ad5509
Jul 25 00:40:56.973919 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.973882    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:56.974111 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.973962    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:56.979159 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:56.979134    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:57.455261 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:57.455184    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h9kmd"
Jul 25 00:40:57.493603 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:57.493568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56498c468c-fpsk4" event={"ID":"e487fc4c-ba16-4672-8c1f-4a30c70b7a84","Type":"ContainerStarted","Data":"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"}
Jul 25 00:40:57.494040 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:57.493617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56498c468c-fpsk4" event={"ID":"e487fc4c-ba16-4672-8c1f-4a30c70b7a84","Type":"ContainerStarted","Data":"7b9ac78be6c45712ac86ceb37cb1e44261334b4d4e07819eec4fa01e65ad5509"}
Jul 25 00:40:57.497552 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:57.497532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:40:57.509719 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:57.509678    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56498c468c-fpsk4" podStartSLOduration=1.5096645149999999 podStartE2EDuration="1.509664515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:40:57.508652607 +0000 UTC m=+297.556380604" watchObservedRunningTime="2026-07-25 00:40:57.509664515 +0000 UTC m=+297.557392564"
Jul 25 00:40:59.339242 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.339198    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry" containerID="cri-o://9fe5dd614ebc3ae141ccd07941a36c2df839e9b54575e90bf735a6edddacb550" gracePeriod=30
Jul 25 00:40:59.502617 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.502581    2574 generic.go:356] "Generic (PLEG): container finished" podID="26c02f23-da30-466b-9409-536e165520c0" containerID="9fe5dd614ebc3ae141ccd07941a36c2df839e9b54575e90bf735a6edddacb550" exitCode=0
Jul 25 00:40:59.502770 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.502658    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" event={"ID":"26c02f23-da30-466b-9409-536e165520c0","Type":"ContainerDied","Data":"9fe5dd614ebc3ae141ccd07941a36c2df839e9b54575e90bf735a6edddacb550"}
Jul 25 00:40:59.579955 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.579934    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:40:59.679791 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679709    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679791 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679772    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679803    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679855    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679885    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679914    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbx92\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679947    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.679991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.679972    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") pod \"26c02f23-da30-466b-9409-536e165520c0\" (UID: \"26c02f23-da30-466b-9409-536e165520c0\") "
Jul 25 00:40:59.681152 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.680336    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:40:59.681303 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.681193    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:40:59.682646 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.682607    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:40:59.682760 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.682704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92" (OuterVolumeSpecName: "kube-api-access-kbx92") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "kube-api-access-kbx92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:40:59.683104 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.683026    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:40:59.683408 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.683371    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:40:59.685503 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.685482    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:40:59.690619 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.690575    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "26c02f23-da30-466b-9409-536e165520c0" (UID: "26c02f23-da30-466b-9409-536e165520c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 00:40:59.780819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780784    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-installation-pull-secrets\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.780819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780812    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26c02f23-da30-466b-9409-536e165520c0-image-registry-private-configuration\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.780819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780823    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26c02f23-da30-466b-9409-536e165520c0-ca-trust-extracted\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.781039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780831    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-trusted-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.781039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780840    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-bound-sa-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.781039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780847    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbx92\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-kube-api-access-kbx92\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.781039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780858    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26c02f23-da30-466b-9409-536e165520c0-registry-certificates\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.781039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.780867    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26c02f23-da30-466b-9409-536e165520c0-registry-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:40:59.893999 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.893964    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:40:59.894260 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.894247    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry"
Jul 25 00:40:59.894260 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.894262    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry"
Jul 25 00:40:59.894389 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.894308    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="26c02f23-da30-466b-9409-536e165520c0" containerName="registry"
Jul 25 00:40:59.902285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.902259    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:40:59.904632 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904587    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 25 00:40:59.904632 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 25 00:40:59.904821 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904653    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 25 00:40:59.904821 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904736    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 25 00:40:59.904928 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904885    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 25 00:40:59.904979 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.904956    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b9r7q\""
Jul 25 00:40:59.906937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.905740    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 25 00:40:59.906937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.905976    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 25 00:40:59.906937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.906266    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cpcs4k007mg2l\""
Jul 25 00:40:59.906937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.906809    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 25 00:40:59.906937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.906812    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 25 00:40:59.907521 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907349    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 25 00:40:59.907521 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907357    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 25 00:40:59.907690 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 25 00:40:59.907751 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907694    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 25 00:40:59.907804 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907778    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 25 00:40:59.907857 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.907844    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 25 00:40:59.910162 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:40:59.910139    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:41:00.083430 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083430 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2cdl\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083569    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083632    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083688    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083704    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083730    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083746    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083813    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083838    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083924    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.083951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.083941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185346 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185351    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185372    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185391    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185691    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185718    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.185787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185854    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185928    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185969    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.185986    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2cdl\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.186504 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.186423    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.187248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.186577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.187248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.186656    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.187248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.186905    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.187248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.187163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.187776 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.187365    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.188483 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.188450    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.189227 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.189201    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.189333 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.189225    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.189404 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.189369    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.189659 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.189637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.190073 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.190030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.190188 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.190079    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.190781 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.190750    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.191430 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.191411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.192024 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.191980    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.192295 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.192276    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.192755 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.192735    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.193825 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.193676    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2cdl\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.193994 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.193977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.214890 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.214866    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:00.364085 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.363989    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 25 00:41:00.373803 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.373741    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:41:00.507096 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.506915    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl"
Jul 25 00:41:00.507096 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.506933    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4488f6c-6bvkl" event={"ID":"26c02f23-da30-466b-9409-536e165520c0","Type":"ContainerDied","Data":"bc5f81ca3d203eed72eeec2455b0eec183f911e230c674792e42700fa755fd5e"}
Jul 25 00:41:00.507096 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.507094    2574 scope.go:117] "RemoveContainer" containerID="9fe5dd614ebc3ae141ccd07941a36c2df839e9b54575e90bf735a6edddacb550"
Jul 25 00:41:00.528611 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.508171    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"01a9816c39ec0293e05476deaddf1561e3b2347ac6718d1225a9a9377683c427"}
Jul 25 00:41:00.528611 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.528377    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:41:00.531590 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:00.531567    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74d4488f6c-6bvkl"]
Jul 25 00:41:01.513812 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:01.513724    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758" exitCode=0
Jul 25 00:41:01.513812 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:01.513775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"}
Jul 25 00:41:01.514858 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:01.514842    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 00:41:02.520666 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:02.520630    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26c02f23-da30-466b-9409-536e165520c0" path="/var/lib/kubelet/pods/26c02f23-da30-466b-9409-536e165520c0/volumes"
Jul 25 00:41:02.866157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:02.866051    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:41:05.534360 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:05.534327    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"}
Jul 25 00:41:05.534754 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:05.534426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"}
Jul 25 00:41:06.370277 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:06.370249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:41:06.515918 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:06.515881    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:41:06.540836 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:06.540799    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"}
Jul 25 00:41:06.541158 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:06.540891    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"}
Jul 25 00:41:06.541158 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:06.540932    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"}
Jul 25 00:41:07.547986 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:07.547952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerStarted","Data":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"}
Jul 25 00:41:07.575924 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:07.575877    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.012183144 podStartE2EDuration="8.575861019s" totalImagesPullingTime="5.543863468s" totalInitContainerRuntime="19.814407ms" isStatefulPod=false podCreationTimestamp="2026-07-25 00:40:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:41:07.573597115 +0000 UTC m=+307.621325109" watchObservedRunningTime="2026-07-25 00:41:07.575861019 +0000 UTC m=+307.623589013"
Jul 25 00:41:10.215389 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:10.215345    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:41:14.196227 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:14.196191    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:41:27.889794 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:27.889732    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56498c468c-fpsk4" podUID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" containerName="console" containerID="cri-o://03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186" gracePeriod=15
Jul 25 00:41:28.125862 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.125834    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:41:28.226320 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226289    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226320 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226320    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226343    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226415    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226433    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w8gp\" (UniqueName: \"kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226462    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226483    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert\") pod \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\" (UID: \"e487fc4c-ba16-4672-8c1f-4a30c70b7a84\") "
Jul 25 00:41:28.226836 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226804    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config" (OuterVolumeSpecName: "console-config") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:28.226933 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226910    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:28.226988 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226923    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca" (OuterVolumeSpecName: "service-ca") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:28.226988 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.226935    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:28.228726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.228698    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:41:28.228819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.228723    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:41:28.228819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.228769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp" (OuterVolumeSpecName: "kube-api-access-7w8gp") pod "e487fc4c-ba16-4672-8c1f-4a30c70b7a84" (UID: "e487fc4c-ba16-4672-8c1f-4a30c70b7a84"). InnerVolumeSpecName "kube-api-access-7w8gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:41:28.327663 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327623    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327663 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327655    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-oauth-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327663 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327665    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327663 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327673    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-trusted-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327918 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327682    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w8gp\" (UniqueName: \"kubernetes.io/projected/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-kube-api-access-7w8gp\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327918 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327691    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-oauth-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.327918 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.327699    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e487fc4c-ba16-4672-8c1f-4a30c70b7a84-console-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:28.628951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.628916    2574 generic.go:356] "Generic (PLEG): container finished" podID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" containerID="03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186" exitCode=0
Jul 25 00:41:28.629117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.628986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56498c468c-fpsk4" event={"ID":"e487fc4c-ba16-4672-8c1f-4a30c70b7a84","Type":"ContainerDied","Data":"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"}
Jul 25 00:41:28.629117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.629001    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56498c468c-fpsk4"
Jul 25 00:41:28.629117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.629032    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56498c468c-fpsk4" event={"ID":"e487fc4c-ba16-4672-8c1f-4a30c70b7a84","Type":"ContainerDied","Data":"7b9ac78be6c45712ac86ceb37cb1e44261334b4d4e07819eec4fa01e65ad5509"}
Jul 25 00:41:28.629117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.629068    2574 scope.go:117] "RemoveContainer" containerID="03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"
Jul 25 00:41:28.637232 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.637213    2574 scope.go:117] "RemoveContainer" containerID="03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"
Jul 25 00:41:28.637506 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:41:28.637484    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186\": container with ID starting with 03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186 not found: ID does not exist" containerID="03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"
Jul 25 00:41:28.637552 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.637517    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186"} err="failed to get container status \"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186\": rpc error: code = NotFound desc = could not find container \"03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186\": container with ID starting with 03bc5c5b4b90b47ad841d54f097243b1e719aa97e103b21270ab5171f439a186 not found: ID does not exist"
Jul 25 00:41:28.643892 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.643869    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:41:28.646770 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:28.646749    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56498c468c-fpsk4"]
Jul 25 00:41:30.520344 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:30.520311    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" path="/var/lib/kubelet/pods/e487fc4c-ba16-4672-8c1f-4a30c70b7a84/volumes"
Jul 25 00:41:39.220184 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.220135    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75c6d68fb9-87fdb" podUID="8781304f-70b3-4518-adc6-cdaf637364a4" containerName="console" containerID="cri-o://04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c" gracePeriod=15
Jul 25 00:41:39.455846 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.455823    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:41:39.630293 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630200    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630293 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630250    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq7vr\" (UniqueName: \"kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630293 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630280    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630515 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630390    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630515 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630450    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630515 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630484    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert\") pod \"8781304f-70b3-4518-adc6-cdaf637364a4\" (UID: \"8781304f-70b3-4518-adc6-cdaf637364a4\") "
Jul 25 00:41:39.630794 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630752    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:39.630933 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630885    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config" (OuterVolumeSpecName: "console-config") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:39.631004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.630925    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:41:39.632622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.632599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr" (OuterVolumeSpecName: "kube-api-access-rq7vr") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "kube-api-access-rq7vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:41:39.632622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.632616    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:41:39.632753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.632599    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8781304f-70b3-4518-adc6-cdaf637364a4" (UID: "8781304f-70b3-4518-adc6-cdaf637364a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:41:39.684048 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.684009    2574 generic.go:356] "Generic (PLEG): container finished" podID="8781304f-70b3-4518-adc6-cdaf637364a4" containerID="04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c" exitCode=0
Jul 25 00:41:39.684220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.684065    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75c6d68fb9-87fdb"
Jul 25 00:41:39.684220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.684109    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c6d68fb9-87fdb" event={"ID":"8781304f-70b3-4518-adc6-cdaf637364a4","Type":"ContainerDied","Data":"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"}
Jul 25 00:41:39.684220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.684158    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75c6d68fb9-87fdb" event={"ID":"8781304f-70b3-4518-adc6-cdaf637364a4","Type":"ContainerDied","Data":"067530ab0b7bb82b60afb95882a2e2b82c40c910429b684a715951bf49fc7665"}
Jul 25 00:41:39.684220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.684182    2574 scope.go:117] "RemoveContainer" containerID="04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"
Jul 25 00:41:39.692673 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.692656    2574 scope.go:117] "RemoveContainer" containerID="04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"
Jul 25 00:41:39.692930 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:41:39.692912    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c\": container with ID starting with 04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c not found: ID does not exist" containerID="04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"
Jul 25 00:41:39.692977 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.692938    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c"} err="failed to get container status \"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c\": rpc error: code = NotFound desc = could not find container \"04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c\": container with ID starting with 04c929cacbcfeed2cef555441019796567a24cd899bb86e4bced65e1454ddd0c not found: ID does not exist"
Jul 25 00:41:39.704137 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.704108    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:41:39.707164 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.707140    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75c6d68fb9-87fdb"]
Jul 25 00:41:39.731891 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731853    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq7vr\" (UniqueName: \"kubernetes.io/projected/8781304f-70b3-4518-adc6-cdaf637364a4-kube-api-access-rq7vr\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:39.731891 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731882    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-oauth-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:39.731891 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731892    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8781304f-70b3-4518-adc6-cdaf637364a4-console-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:39.732145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731902    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-console-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:39.732145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731912    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-oauth-serving-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:39.732145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:39.731919    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8781304f-70b3-4518-adc6-cdaf637364a4-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:41:40.520339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:41:40.520308    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8781304f-70b3-4518-adc6-cdaf637364a4" path="/var/lib/kubelet/pods/8781304f-70b3-4518-adc6-cdaf637364a4/volumes"
Jul 25 00:42:00.215614 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:00.215512    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:00.237565 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:00.237506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:00.771372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:00.771345    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:14.304705 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.304667    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:42:14.306951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.306930    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf10a4aa-bf28-4187-b2cd-8e911b7941fd-metrics-certs\") pod \"network-metrics-daemon-2s69q\" (UID: \"cf10a4aa-bf28-4187-b2cd-8e911b7941fd\") " pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:42:14.319600 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.319578    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xdtb\""
Jul 25 00:42:14.327386 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.327368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2s69q"
Jul 25 00:42:14.454210 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.454170    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2s69q"]
Jul 25 00:42:14.459558 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:42:14.459525    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf10a4aa_bf28_4187_b2cd_8e911b7941fd.slice/crio-dd84ae60756f32ff9bbb334f122b9ee356fcfc902c90fb53bbcd675623d6b587 WatchSource:0}: Error finding container dd84ae60756f32ff9bbb334f122b9ee356fcfc902c90fb53bbcd675623d6b587: Status 404 returned error can't find the container with id dd84ae60756f32ff9bbb334f122b9ee356fcfc902c90fb53bbcd675623d6b587
Jul 25 00:42:14.804286 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:14.804249    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2s69q" event={"ID":"cf10a4aa-bf28-4187-b2cd-8e911b7941fd","Type":"ContainerStarted","Data":"dd84ae60756f32ff9bbb334f122b9ee356fcfc902c90fb53bbcd675623d6b587"}
Jul 25 00:42:15.808953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:15.808910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2s69q" event={"ID":"cf10a4aa-bf28-4187-b2cd-8e911b7941fd","Type":"ContainerStarted","Data":"b08fcd5712afc558363ebf8649d5c76128a5ae0b098110d3d273750957e459b2"}
Jul 25 00:42:15.809361 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:15.808976    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2s69q" event={"ID":"cf10a4aa-bf28-4187-b2cd-8e911b7941fd","Type":"ContainerStarted","Data":"e3695508c81cd6c88ca89dc1336f5b8f992dac1bbf46055f83a7fbba6c7b8588"}
Jul 25 00:42:15.824676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:15.824631    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2s69q" podStartSLOduration=373.855579613 podStartE2EDuration="6m14.824616242s" totalImagesPullingTime="969.036629ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:42:15.822596515 +0000 UTC m=+375.870324509" watchObservedRunningTime="2026-07-25 00:42:15.824616242 +0000 UTC m=+375.872344236"
Jul 25 00:42:18.273013 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.272961    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:18.273879 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273846    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="prometheus" containerID="cri-o://aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48" gracePeriod=600
Jul 25 00:42:18.274100 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273863    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy" containerID="cri-o://11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993" gracePeriod=600
Jul 25 00:42:18.274225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273889    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c" gracePeriod=600
Jul 25 00:42:18.274225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273889    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="config-reloader" containerID="cri-o://f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f" gracePeriod=600
Jul 25 00:42:18.274312 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273931    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-web" containerID="cri-o://bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90" gracePeriod=600
Jul 25 00:42:18.274366 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.273936    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="thanos-sidecar" containerID="cri-o://c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2" gracePeriod=600
Jul 25 00:42:18.531348 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.531285    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:18.640101 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640047    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640112    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640137    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640173    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640196    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640218    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640285 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640242    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640365    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640403    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640432    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640494    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640530    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640592 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640568    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640620    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2cdl\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640646    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640644    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640713    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640741    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.640930 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.640769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle\") pod \"96a9ad92-2428-4780-9bb6-6e28a36172cf\" (UID: \"96a9ad92-2428-4780-9bb6-6e28a36172cf\") "
Jul 25 00:42:18.641315 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.641122    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-metrics-client-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.641678 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.641628    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.641792 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.641689    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 00:42:18.641792 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.641702    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.642008 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.641980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.642247 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.642089    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.642377 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.642356    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.644126 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644098    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.644426 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644397    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 00:42:18.644588 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644565    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config" (OuterVolumeSpecName: "config") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.644654 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644623    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.644731 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644714    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.644831 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644804    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out" (OuterVolumeSpecName: "config-out") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 00:42:18.644947 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644924    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl" (OuterVolumeSpecName: "kube-api-access-d2cdl") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "kube-api-access-d2cdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:42:18.645016 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.644933    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.645473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.645446    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.645603 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.645584    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.645652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.645612    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.646032 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.646007    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:42:18.654225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.654202    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config" (OuterVolumeSpecName: "web-config") pod "96a9ad92-2428-4780-9bb6-6e28a36172cf" (UID: "96a9ad92-2428-4780-9bb6-6e28a36172cf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:42:18.742349 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742311    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742349 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742336    2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742349 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742346    2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-metrics-client-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742349 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742358    2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-kube-rbac-proxy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742367    2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-web-config\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742375    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742386    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742395    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742403    2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742411    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742421    2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-tls-assets\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742429    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2cdl\" (UniqueName: \"kubernetes.io/projected/96a9ad92-2428-4780-9bb6-6e28a36172cf-kube-api-access-d2cdl\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742437    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742447    2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-grpc-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742455    2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-config-out\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742462    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742470    2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96a9ad92-2428-4780-9bb6-6e28a36172cf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742479    2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/96a9ad92-2428-4780-9bb6-6e28a36172cf-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.742628 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.742489    2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/96a9ad92-2428-4780-9bb6-6e28a36172cf-prometheus-k8s-db\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.822982    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823013    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823022    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823030    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823037    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823046    2574 generic.go:356] "Generic (PLEG): container finished" podID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48" exitCode=0
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823078    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"}
Jul 25 00:42:18.823092 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823095    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823146    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"}
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"}
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"}
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823218    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823233    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"}
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823258    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"}
Jul 25 00:42:18.823489 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.823282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"96a9ad92-2428-4780-9bb6-6e28a36172cf","Type":"ContainerDied","Data":"01a9816c39ec0293e05476deaddf1561e3b2347ac6718d1225a9a9377683c427"}
Jul 25 00:42:18.831408 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.831388    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.838034 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.838019    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.844486 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.844471    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.848715 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.848695    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:18.852481 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.852459    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:18.854040 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.854018    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.861145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.861130    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.867887 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.867870    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.875192 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.875172    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.875629 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.875588    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.875726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.875663    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.875726 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.875694    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.876103 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.876072    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.876175 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876113    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.876238 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876142    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.876527 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.876505    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.876601 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876536    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.876601 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876556    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.876886 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.876854    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.876948 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876893    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.877014 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.876993    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:18.877081 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877017    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.877341 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.877321    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.877405 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877347    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.877405 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877366    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.877559 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877540    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="init-config-reloader"
Jul 25 00:42:18.877612 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877561    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="init-config-reloader"
Jul 25 00:42:18.877612 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877579    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy"
Jul 25 00:42:18.877612 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877593    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877612    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" containerName="console"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877620    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" containerName="console"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877642    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="prometheus"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877650    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="prometheus"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.877658    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877686    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.877747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877707    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877670    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="config-reloader"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877791    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="config-reloader"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877811    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="thanos-sidecar"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877820    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="thanos-sidecar"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877830    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-web"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877839    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-web"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877857    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-thanos"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877865    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-thanos"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877879    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8781304f-70b3-4518-adc6-cdaf637364a4" containerName="console"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.877888    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8781304f-70b3-4518-adc6-cdaf637364a4" containerName="console"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878031    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8781304f-70b3-4518-adc6-cdaf637364a4" containerName="console"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878047    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e487fc4c-ba16-4672-8c1f-4a30c70b7a84" containerName="console"
Jul 25 00:42:18.878108 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878113    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-web"
Jul 25 00:42:18.878652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878124    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy-thanos"
Jul 25 00:42:18.878652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878140    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="prometheus"
Jul 25 00:42:18.878652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878149    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="thanos-sidecar"
Jul 25 00:42:18.878652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878158    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="kube-rbac-proxy"
Jul 25 00:42:18.878652 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.878172    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" containerName="config-reloader"
Jul 25 00:42:18.879137 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:42:18.879113    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.879221 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.879142    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.879221 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.879161    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.880763 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.880737    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.880860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.880765    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.883505 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883478    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.883505 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883504    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.883758 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883738    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.883829 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883760    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.883982 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883964    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.884025 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.883984    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.884213 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884196    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.884213 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884212    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.884429 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884409    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.884490 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884430    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.884631 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884616    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.884679 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884631    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.884860 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884841    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.884901 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.884861    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.885102 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885084    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.885153 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885103    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.885305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885287    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.885342 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885305    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.885377 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885362    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:18.885492 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885472    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.885564 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885494    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.885829 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885801    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.885829 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.885829    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.886097 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.886071    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.886097 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.886094    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.886767 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.886741    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.886767 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.886768    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.887008 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.886988    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.887076 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887008    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.887250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887232    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.887250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887250    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.887492 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887473    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.887567 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887515    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.887787 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887763    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.887856 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887788    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.887987 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887967    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 25 00:42:18.887987 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.887982    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cpcs4k007mg2l\""
Jul 25 00:42:18.888174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888014    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 25 00:42:18.888174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888035    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 25 00:42:18.888174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888037    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 25 00:42:18.888174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888127    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.888174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888147    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.888401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888347    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.888401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888363    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.888504 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888408    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 25 00:42:18.888504 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888487    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 25 00:42:18.888634 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888516    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 25 00:42:18.888634 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888532    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b9r7q\""
Jul 25 00:42:18.888634 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888565    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 25 00:42:18.888634 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888606    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 25 00:42:18.888818 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888642    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.888818 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888665    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.888818 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888682    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 25 00:42:18.888965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888865    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 25 00:42:18.889012 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888959    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.889012 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.888990    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.889133 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889112    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 25 00:42:18.889181 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889141    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 25 00:42:18.889295 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889275    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.889373 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889297    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.889574 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889544    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.889574 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889569    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.889887 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889859    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.889980 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.889887    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.890157 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890133    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.890249 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890159    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.890482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890462    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.890569 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890484    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.890791 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890761    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.890791 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.890784    2574 scope.go:117] "RemoveContainer" containerID="dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"
Jul 25 00:42:18.891102 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891040    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c"} err="failed to get container status \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": rpc error: code = NotFound desc = could not find container \"dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c\": container with ID starting with dcecc4dfe6f9fc2b26fcbb1dee1149c0e35fd934cbc1904bcf09000580dcbc1c not found: ID does not exist"
Jul 25 00:42:18.891102 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891086    2574 scope.go:117] "RemoveContainer" containerID="11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"
Jul 25 00:42:18.891305 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891188    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 25 00:42:18.891401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891376    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993"} err="failed to get container status \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": rpc error: code = NotFound desc = could not find container \"11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993\": container with ID starting with 11871a4c3c5f460230a33830f64973af9ade0c060d65c7772e0ee3365d255993 not found: ID does not exist"
Jul 25 00:42:18.891401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891404    2574 scope.go:117] "RemoveContainer" containerID="bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"
Jul 25 00:42:18.891661 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891627    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90"} err="failed to get container status \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": rpc error: code = NotFound desc = could not find container \"bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90\": container with ID starting with bd4262400fbfa421230a570ac92369ee4511cd0ae1e2c6d14ec71f749e8aaf90 not found: ID does not exist"
Jul 25 00:42:18.891661 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891653    2574 scope.go:117] "RemoveContainer" containerID="c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"
Jul 25 00:42:18.891953 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891930    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2"} err="failed to get container status \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": rpc error: code = NotFound desc = could not find container \"c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2\": container with ID starting with c2ef7c611557da468e133442253b955f555101cacf5e041f3ef7e1e7e0b0c5a2 not found: ID does not exist"
Jul 25 00:42:18.892111 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.891955    2574 scope.go:117] "RemoveContainer" containerID="f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"
Jul 25 00:42:18.892553 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.892244    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f"} err="failed to get container status \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": rpc error: code = NotFound desc = could not find container \"f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f\": container with ID starting with f03d9fe9b10d8b46ed5cc1864345b24f85f7fafcc66ac8719e2013a749ee4c9f not found: ID does not exist"
Jul 25 00:42:18.892553 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.892272    2574 scope.go:117] "RemoveContainer" containerID="aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"
Jul 25 00:42:18.892699 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.892637    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48"} err="failed to get container status \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": rpc error: code = NotFound desc = could not find container \"aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48\": container with ID starting with aebfe1cd6540b9db4e29a374d0ce652d420e399d4056865c1abd1f122c688e48 not found: ID does not exist"
Jul 25 00:42:18.892699 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.892659    2574 scope.go:117] "RemoveContainer" containerID="95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"
Jul 25 00:42:18.892952 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.892909    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758"} err="failed to get container status \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": rpc error: code = NotFound desc = could not find container \"95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758\": container with ID starting with 95fcac81aa8d0176dddfff606691b367e9dc7f421c41523fe0a078ac58b0c758 not found: ID does not exist"
Jul 25 00:42:18.894689 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.894673    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 25 00:42:18.894753 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:18.894720    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:19.044750 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.044750 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044753    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7sd\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-kube-api-access-2r7sd\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044869    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044903    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044950    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.044999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045030    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045105    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045134 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045149    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045188    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045207    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.045482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.045366    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146555    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146595    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146611    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146631    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146654    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.146809 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146850    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146885    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146911    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7sd\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-kube-api-access-2r7sd\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.146972    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147004    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147078    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147225 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147112    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147703 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147703 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147703 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147492    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.147703 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.148016 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.147977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.149330    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.149945    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config-out\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.150432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.150467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.150553    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.151487 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.150826    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152098 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.151881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152098 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.151984    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91b7fffc-4fcc-4405-ada2-5ea24dabe486-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152098 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.151995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152206 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.152099    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152206 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.152178    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-web-config\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152348 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.152332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.152484 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.152467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91b7fffc-4fcc-4405-ada2-5ea24dabe486-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.154467 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.154448    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7sd\" (UniqueName: \"kubernetes.io/projected/91b7fffc-4fcc-4405-ada2-5ea24dabe486-kube-api-access-2r7sd\") pod \"prometheus-k8s-0\" (UID: \"91b7fffc-4fcc-4405-ada2-5ea24dabe486\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.197512 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.197492    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:42:19.327484 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.327455    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 25 00:42:19.330469 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:42:19.330446    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b7fffc_4fcc_4405_ada2_5ea24dabe486.slice/crio-c7e9c1f1d7a2edb250ff218090b7a03c477294eec557e98a1966a90a3667b94a WatchSource:0}: Error finding container c7e9c1f1d7a2edb250ff218090b7a03c477294eec557e98a1966a90a3667b94a: Status 404 returned error can't find the container with id c7e9c1f1d7a2edb250ff218090b7a03c477294eec557e98a1966a90a3667b94a
Jul 25 00:42:19.828295 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.828265    2574 generic.go:356] "Generic (PLEG): container finished" podID="91b7fffc-4fcc-4405-ada2-5ea24dabe486" containerID="13d0243f13b4e8e19964a484261122f84ad2e3282ca0f0360ba08bf982880476" exitCode=0
Jul 25 00:42:19.828589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.828368    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerDied","Data":"13d0243f13b4e8e19964a484261122f84ad2e3282ca0f0360ba08bf982880476"}
Jul 25 00:42:19.828589 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:19.828456    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"c7e9c1f1d7a2edb250ff218090b7a03c477294eec557e98a1966a90a3667b94a"}
Jul 25 00:42:20.520287 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.520255    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96a9ad92-2428-4780-9bb6-6e28a36172cf" path="/var/lib/kubelet/pods/96a9ad92-2428-4780-9bb6-6e28a36172cf/volumes"
Jul 25 00:42:20.836265 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836182    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"b3418f4594f6691c58661fc957b502ce6431f7bbdb5d722a054065881ad10a40"}
Jul 25 00:42:20.836401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836264    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"a5386397c895fefa0c30905c125719014bf6f1450a93b025b1a5247a7f3a50ea"}
Jul 25 00:42:20.836401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"1e65551aa7666c41dc9e6ea95059f809a47239a9d923135cdca7f15e9a502baa"}
Jul 25 00:42:20.836401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836349    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"a5da77741f7f08f5b5ee2535f8c16dd564b843b8b1b8b5ac1eb0385618d45aa5"}
Jul 25 00:42:20.836401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836384    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"dad94d0ecd5d59a5479b5b7170ed89355dde92faf0cbad914698c9f6bf58ebb4"}
Jul 25 00:42:20.836529 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.836420    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91b7fffc-4fcc-4405-ada2-5ea24dabe486","Type":"ContainerStarted","Data":"bb1ffed53156d818d3eb430d4544310ffb6d752fea9dab7ddabf17e9cd56f7cb"}
Jul 25 00:42:20.862766 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:20.862720    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.840134571 podStartE2EDuration="2.862700459s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.565888ms" isStatefulPod=false podCreationTimestamp="2026-07-25 00:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:42:20.860464229 +0000 UTC m=+380.908192224" watchObservedRunningTime="2026-07-25 00:42:20.862700459 +0000 UTC m=+380.910428453"
Jul 25 00:42:24.198580 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:42:24.198543    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:43:19.198264 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:43:19.198227    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:43:19.213562 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:43:19.213537    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:43:20.059561 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:43:20.059533    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 25 00:45:22.586069 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.586028    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"]
Jul 25 00:45:22.589264 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.589248    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.592614 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.592593    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 25 00:45:22.593232 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.593213    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 25 00:45:22.593386 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.593349    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rcwf8\""
Jul 25 00:45:22.593505 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.593371    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 25 00:45:22.593505 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.593417    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 25 00:45:22.604199 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.604177    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"]
Jul 25 00:45:22.656472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.656442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-manifests\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.656596 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.656489    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.656646 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.656586    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-tmp\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.656646 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.656637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znz25\" (UniqueName: \"kubernetes.io/projected/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-kube-api-access-znz25\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.656723 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.656665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.757718 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.757686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-manifests\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.757889 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.757733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.757889 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.757779    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-tmp\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.757889 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.757807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znz25\" (UniqueName: \"kubernetes.io/projected/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-kube-api-access-znz25\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.757889 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.757834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.758219 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.758117    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-manifests\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.760044 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.760021    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-tmp\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.760297 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.760278    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.760367 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.760340    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.767410 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.767384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znz25\" (UniqueName: \"kubernetes.io/projected/803b08ea-1fec-48a5-b00c-66bd5cbb16fb-kube-api-access-znz25\") pod \"opendatahub-operator-controller-manager-9b8579fc9-bcsjr\" (UID: \"803b08ea-1fec-48a5-b00c-66bd5cbb16fb\") " pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:22.899624 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:22.899537    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:23.032642 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:23.032605    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"]
Jul 25 00:45:23.035767 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:45:23.035738    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803b08ea_1fec_48a5_b00c_66bd5cbb16fb.slice/crio-c0e3a739eae8d3229e643cf86ef281ab3691fdd5a275648e9778d2249cb30674 WatchSource:0}: Error finding container c0e3a739eae8d3229e643cf86ef281ab3691fdd5a275648e9778d2249cb30674: Status 404 returned error can't find the container with id c0e3a739eae8d3229e643cf86ef281ab3691fdd5a275648e9778d2249cb30674
Jul 25 00:45:23.480454 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:23.480414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr" event={"ID":"803b08ea-1fec-48a5-b00c-66bd5cbb16fb","Type":"ContainerStarted","Data":"c0e3a739eae8d3229e643cf86ef281ab3691fdd5a275648e9778d2249cb30674"}
Jul 25 00:45:26.494297 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:26.494263    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr" event={"ID":"803b08ea-1fec-48a5-b00c-66bd5cbb16fb","Type":"ContainerStarted","Data":"44b36076f96dd93ad7c66a106f87d0f2682013c10b02b553b234f5065351c63e"}
Jul 25 00:45:27.499345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:27.499311    2574 generic.go:356] "Generic (PLEG): container finished" podID="803b08ea-1fec-48a5-b00c-66bd5cbb16fb" containerID="44b36076f96dd93ad7c66a106f87d0f2682013c10b02b553b234f5065351c63e" exitCode=0
Jul 25 00:45:27.499733 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:27.499359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr" event={"ID":"803b08ea-1fec-48a5-b00c-66bd5cbb16fb","Type":"ContainerDied","Data":"44b36076f96dd93ad7c66a106f87d0f2682013c10b02b553b234f5065351c63e"}
Jul 25 00:45:28.505342 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:28.505247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr" event={"ID":"803b08ea-1fec-48a5-b00c-66bd5cbb16fb","Type":"ContainerStarted","Data":"ec29292db993546bb6694ce6aad4f97e8f8ac7229ec9abc18f3f13517f4df424"}
Jul 25 00:45:28.505793 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:28.505386    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:28.523784 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:28.523733    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr" podStartSLOduration=1.731465764 podStartE2EDuration="6.523711427s" totalImagesPullingTime="3.72493507s" totalInitContainerRuntime="1.067310593s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:45:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:45:28.5220807 +0000 UTC m=+568.569808701" watchObservedRunningTime="2026-07-25 00:45:28.523711427 +0000 UTC m=+568.571439428"
Jul 25 00:45:39.511948 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:39.511912    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9b8579fc9-bcsjr"
Jul 25 00:45:45.922252 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.922219    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"]
Jul 25 00:45:45.932682 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.932658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:45.936093 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936032    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 25 00:45:45.936254 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936098    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 25 00:45:45.936254 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936152    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 25 00:45:45.936254 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936245    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7sgxr\""
Jul 25 00:45:45.936479 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936453    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 25 00:45:45.936633 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936456    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 25 00:45:45.936805 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:45.936784    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"]
Jul 25 00:45:46.053323 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.053286    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcsft\" (UniqueName: \"kubernetes.io/projected/887d95a9-30bb-43fc-8251-2ceb9191819f-kube-api-access-gcsft\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.053323 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.053320    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.053542 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.053351    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887d95a9-30bb-43fc-8251-2ceb9191819f-manager-config\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.053542 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.053421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-metrics-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.154710 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.154670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.154710 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.154716    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887d95a9-30bb-43fc-8251-2ceb9191819f-manager-config\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.154896 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.154841    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-metrics-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.154942 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.154932    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcsft\" (UniqueName: \"kubernetes.io/projected/887d95a9-30bb-43fc-8251-2ceb9191819f-kube-api-access-gcsft\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.155331 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.155306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/887d95a9-30bb-43fc-8251-2ceb9191819f-manager-config\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.157447 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.157419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.157575 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.157555    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/887d95a9-30bb-43fc-8251-2ceb9191819f-metrics-cert\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.163341 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.163319    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcsft\" (UniqueName: \"kubernetes.io/projected/887d95a9-30bb-43fc-8251-2ceb9191819f-kube-api-access-gcsft\") pod \"lws-controller-manager-7bd5dcbf9d-6kqmc\" (UID: \"887d95a9-30bb-43fc-8251-2ceb9191819f\") " pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.243814 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.243760    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:46.369104 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.369069    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"]
Jul 25 00:45:46.372110 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:45:46.372087    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887d95a9_30bb_43fc_8251_2ceb9191819f.slice/crio-27ed2e54340a82a130a2e0c49435302efec78d6b189736c1f43404c1a524ef8a WatchSource:0}: Error finding container 27ed2e54340a82a130a2e0c49435302efec78d6b189736c1f43404c1a524ef8a: Status 404 returned error can't find the container with id 27ed2e54340a82a130a2e0c49435302efec78d6b189736c1f43404c1a524ef8a
Jul 25 00:45:46.573747 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:46.573665    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc" event={"ID":"887d95a9-30bb-43fc-8251-2ceb9191819f","Type":"ContainerStarted","Data":"27ed2e54340a82a130a2e0c49435302efec78d6b189736c1f43404c1a524ef8a"}
Jul 25 00:45:47.422168 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.421934    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"]
Jul 25 00:45:47.424625 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.424602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.429150 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.428675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 25 00:45:47.429150 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.428727    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 25 00:45:47.429150 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.428675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 25 00:45:47.429150 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.428928    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8r4pz\""
Jul 25 00:45:47.429150 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.429039    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 25 00:45:47.438711 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.438651    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"]
Jul 25 00:45:47.566813 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.566731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.566813 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.566776    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqgpd\" (UniqueName: \"kubernetes.io/projected/bb3e719b-3dad-47d8-b20d-2312588eea4c-kube-api-access-bqgpd\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.567101 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.566910    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb3e719b-3dad-47d8-b20d-2312588eea4c-tmp\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.668175 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.668137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.668343 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.668185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqgpd\" (UniqueName: \"kubernetes.io/projected/bb3e719b-3dad-47d8-b20d-2312588eea4c-kube-api-access-bqgpd\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.668343 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.668242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb3e719b-3dad-47d8-b20d-2312588eea4c-tmp\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.668343 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:45:47.668319    2574 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 25 00:45:47.668523 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:45:47.668398    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs podName:bb3e719b-3dad-47d8-b20d-2312588eea4c nodeName:}" failed. No retries permitted until 2026-07-25 00:45:48.168375329 +0000 UTC m=+588.216103323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs") pod "kube-auth-proxy-68546f88c4-v9bpz" (UID: "bb3e719b-3dad-47d8-b20d-2312588eea4c") : secret "kube-auth-proxy-tls" not found
Jul 25 00:45:47.671786 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.671740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb3e719b-3dad-47d8-b20d-2312588eea4c-tmp\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:47.677220 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:47.677143    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqgpd\" (UniqueName: \"kubernetes.io/projected/bb3e719b-3dad-47d8-b20d-2312588eea4c-kube-api-access-bqgpd\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:48.172656 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:48.172615    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:48.175284 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:48.175259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb3e719b-3dad-47d8-b20d-2312588eea4c-tls-certs\") pod \"kube-auth-proxy-68546f88c4-v9bpz\" (UID: \"bb3e719b-3dad-47d8-b20d-2312588eea4c\") " pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:48.346778 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:48.346743    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"
Jul 25 00:45:49.266938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:49.266913    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz"]
Jul 25 00:45:49.268723 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:45:49.268699    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3e719b_3dad_47d8_b20d_2312588eea4c.slice/crio-629878bcba66269e8880b9c1e9fb51e5e89d58be38803febfbd34828c72ffc8f WatchSource:0}: Error finding container 629878bcba66269e8880b9c1e9fb51e5e89d58be38803febfbd34828c72ffc8f: Status 404 returned error can't find the container with id 629878bcba66269e8880b9c1e9fb51e5e89d58be38803febfbd34828c72ffc8f
Jul 25 00:45:49.587702 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:49.587669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz" event={"ID":"bb3e719b-3dad-47d8-b20d-2312588eea4c","Type":"ContainerStarted","Data":"629878bcba66269e8880b9c1e9fb51e5e89d58be38803febfbd34828c72ffc8f"}
Jul 25 00:45:49.588981 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:49.588952    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc" event={"ID":"887d95a9-30bb-43fc-8251-2ceb9191819f","Type":"ContainerStarted","Data":"de3c0a7a48c351321060d5661e7f529eb58bbc7ea9ecb3a1a270edb4157a085f"}
Jul 25 00:45:49.589111 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:49.589040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:45:49.608345 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:49.608294    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc" podStartSLOduration=1.7825557189999999 podStartE2EDuration="4.60827715s" totalImagesPullingTime="2.825721431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:45:49.607570368 +0000 UTC m=+589.655298366" watchObservedRunningTime="2026-07-25 00:45:49.60827715 +0000 UTC m=+589.656005145"
Jul 25 00:45:51.598869 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:51.598836    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz" event={"ID":"bb3e719b-3dad-47d8-b20d-2312588eea4c","Type":"ContainerStarted","Data":"76269ed8d612415554ea7ac3ccc987771a235ccc2a68ab13789333a9ff9bf2c3"}
Jul 25 00:45:51.618239 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:45:51.618187    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68546f88c4-v9bpz" podStartSLOduration=2.481776112 podStartE2EDuration="4.618169877s" totalImagesPullingTime="2.136393765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:45:51.616590733 +0000 UTC m=+591.664318728" watchObservedRunningTime="2026-07-25 00:45:51.618169877 +0000 UTC m=+591.665897871"
Jul 25 00:46:00.596370 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:46:00.596268    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bd5dcbf9d-6kqmc"
Jul 25 00:47:35.365510 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.365473    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"]
Jul 25 00:47:35.368662 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.368646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.370751 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.370728    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 25 00:47:35.370874 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.370787    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 25 00:47:35.370874 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.370805    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 25 00:47:35.371498 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.371480    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 25 00:47:35.371581 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.371483    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9qz72\""
Jul 25 00:47:35.373972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.373950    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"]
Jul 25 00:47:35.472126 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.472092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.472284 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.472148    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.472284 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.472213    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f5bc\" (UniqueName: \"kubernetes.io/projected/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-kube-api-access-9f5bc\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.572541 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.572508    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.572711 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.572568    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f5bc\" (UniqueName: \"kubernetes.io/projected/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-kube-api-access-9f5bc\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.572711 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.572609    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.573289 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.573269    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.574987 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.574958    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.579636 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.579611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f5bc\" (UniqueName: \"kubernetes.io/projected/e55b7397-e9bd-492c-bf47-58aa8e0a7cc4-kube-api-access-9f5bc\") pod \"kuadrant-console-plugin-66b5774985-ptpng\" (UID: \"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.678582 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.678500    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"
Jul 25 00:47:35.804366 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.803774    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng"]
Jul 25 00:47:35.809935 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:35.809911    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 00:47:36.001534 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:36.001497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng" event={"ID":"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4","Type":"ContainerStarted","Data":"81b78bb108c1d3582037872f1da9adc0ed07fc6c1885c466b52b7133c52d55de"}
Jul 25 00:47:59.111258 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:59.111215    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng" event={"ID":"e55b7397-e9bd-492c-bf47-58aa8e0a7cc4","Type":"ContainerStarted","Data":"748c621768f3fb4e895ecc338d16a67320782c5d75e6c154cfa68cbf0274d123"}
Jul 25 00:47:59.126460 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:47:59.126407    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ptpng" podStartSLOduration=1.675116113 podStartE2EDuration="24.126391149s" totalImagesPullingTime="22.451275036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:47:59.125702031 +0000 UTC m=+719.173430026" watchObservedRunningTime="2026-07-25 00:47:59.126391149 +0000 UTC m=+719.174119144"
Jul 25 00:48:15.702410 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.702377    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"]
Jul 25 00:48:15.706187 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.706158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.709294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.708930    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bwdnp\""
Jul 25 00:48:15.709294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.708984    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 25 00:48:15.717025 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.717001    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"]
Jul 25 00:48:15.814892 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814854    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03888453-1ee8-4de2-962f-3a9266354cd5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814935    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzwn\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-kube-api-access-jpzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814958    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814973    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.814993    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.815009    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.815079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.815144 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.815120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03888453-1ee8-4de2-962f-3a9266354cd5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.915891 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915902    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzwn\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-kube-api-access-jpzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915942    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915962    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.915996    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03888453-1ee8-4de2-962f-3a9266354cd5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916078 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916045    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03888453-1ee8-4de2-962f-3a9266354cd5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916475 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916475 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916710 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916688    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916785 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03888453-1ee8-4de2-962f-3a9266354cd5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.916830 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.916761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.918392 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.918371    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03888453-1ee8-4de2-962f-3a9266354cd5-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.918570 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.918544    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03888453-1ee8-4de2-962f-3a9266354cd5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.923395 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.923370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:15.924265 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:15.924243    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzwn\" (UniqueName: \"kubernetes.io/projected/03888453-1ee8-4de2-962f-3a9266354cd5-kube-api-access-jpzwn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wbcf5\" (UID: \"03888453-1ee8-4de2-962f-3a9266354cd5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:16.017250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:16.017212    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:16.141402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:16.141310    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"]
Jul 25 00:48:16.144028 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:48:16.143999    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03888453_1ee8_4de2_962f_3a9266354cd5.slice/crio-de53d8446058304c971aa3aabb12a62a1bc70be80dcd3339fb4407ff5a8a0dec WatchSource:0}: Error finding container de53d8446058304c971aa3aabb12a62a1bc70be80dcd3339fb4407ff5a8a0dec: Status 404 returned error can't find the container with id de53d8446058304c971aa3aabb12a62a1bc70be80dcd3339fb4407ff5a8a0dec
Jul 25 00:48:16.178023 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:16.177993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" event={"ID":"03888453-1ee8-4de2-962f-3a9266354cd5","Type":"ContainerStarted","Data":"de53d8446058304c971aa3aabb12a62a1bc70be80dcd3339fb4407ff5a8a0dec"}
Jul 25 00:48:18.822363 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:18.822325    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:48:18.822668 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:18.822399    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:48:18.822668 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:18.822429    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:48:19.195738 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:19.195658    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" event={"ID":"03888453-1ee8-4de2-962f-3a9266354cd5","Type":"ContainerStarted","Data":"7664d5ef7bbba8ac02865f8a87fa2182f38cd1b6f923e6a55976c7fb4d896291"}
Jul 25 00:48:19.214603 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:19.214557    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" podStartSLOduration=1.538495639 podStartE2EDuration="4.214535054s" totalImagesPullingTime="2.676039415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:48:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:48:19.212433908 +0000 UTC m=+739.260161903" watchObservedRunningTime="2026-07-25 00:48:19.214535054 +0000 UTC m=+739.262263049"
Jul 25 00:48:20.018118 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:20.018079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:20.022830 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:20.022804    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:20.199765 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:20.199732    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:20.200648 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:20.200625    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:48:30.773929 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:30.773898    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:48:30.804929 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:30.804902    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:48:30.805093 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:30.804987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:48:30.807174 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:30.807153    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nn7tv\""
Jul 25 00:48:30.944871 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:30.944835    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbghp\" (UniqueName: \"kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp\") pod \"authorino-75d556bd77-svjf4\" (UID: \"c2aa041a-0dbb-413a-874f-868e1b0a3788\") " pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:48:31.046028 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:31.045941    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbghp\" (UniqueName: \"kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp\") pod \"authorino-75d556bd77-svjf4\" (UID: \"c2aa041a-0dbb-413a-874f-868e1b0a3788\") " pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:48:31.056409 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:31.056376    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbghp\" (UniqueName: \"kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp\") pod \"authorino-75d556bd77-svjf4\" (UID: \"c2aa041a-0dbb-413a-874f-868e1b0a3788\") " pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:48:31.114035 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:31.114002    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:48:31.240369 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:31.240339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:48:31.243700 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:48:31.243677    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2aa041a_0dbb_413a_874f_868e1b0a3788.slice/crio-cb739d79be98b504f22ebce4fbb1b9c945e1a052c517cf5b57464262a6db7984 WatchSource:0}: Error finding container cb739d79be98b504f22ebce4fbb1b9c945e1a052c517cf5b57464262a6db7984: Status 404 returned error can't find the container with id cb739d79be98b504f22ebce4fbb1b9c945e1a052c517cf5b57464262a6db7984
Jul 25 00:48:32.255216 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:32.255174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-svjf4" event={"ID":"c2aa041a-0dbb-413a-874f-868e1b0a3788","Type":"ContainerStarted","Data":"cb739d79be98b504f22ebce4fbb1b9c945e1a052c517cf5b57464262a6db7984"}
Jul 25 00:48:34.265640 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:34.265602    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-svjf4" event={"ID":"c2aa041a-0dbb-413a-874f-868e1b0a3788","Type":"ContainerStarted","Data":"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"}
Jul 25 00:48:34.279391 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:48:34.279347    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-svjf4" podStartSLOduration=1.340275362 podStartE2EDuration="4.279328976s" totalImagesPullingTime="2.939053614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:48:34.278319206 +0000 UTC m=+754.326047203" watchObservedRunningTime="2026-07-25 00:48:34.279328976 +0000 UTC m=+754.327056972"
Jul 25 00:49:00.775499 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:00.775466    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:49:00.775952 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:00.775689    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-svjf4" podUID="c2aa041a-0dbb-413a-874f-868e1b0a3788" containerName="authorino" containerID="cri-o://267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb" gracePeriod=30
Jul 25 00:49:01.011245 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.011211    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:49:01.110551 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.110460    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbghp\" (UniqueName: \"kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp\") pod \"c2aa041a-0dbb-413a-874f-868e1b0a3788\" (UID: \"c2aa041a-0dbb-413a-874f-868e1b0a3788\") "
Jul 25 00:49:01.112611 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.112584    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp" (OuterVolumeSpecName: "kube-api-access-bbghp") pod "c2aa041a-0dbb-413a-874f-868e1b0a3788" (UID: "c2aa041a-0dbb-413a-874f-868e1b0a3788"). InnerVolumeSpecName "kube-api-access-bbghp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:49:01.211136 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.211102    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbghp\" (UniqueName: \"kubernetes.io/projected/c2aa041a-0dbb-413a-874f-868e1b0a3788-kube-api-access-bbghp\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:49:01.376052 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.375967    2574 generic.go:356] "Generic (PLEG): container finished" podID="c2aa041a-0dbb-413a-874f-868e1b0a3788" containerID="267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb" exitCode=0
Jul 25 00:49:01.376052 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.376009    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-svjf4"
Jul 25 00:49:01.376052 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.376021    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-svjf4" event={"ID":"c2aa041a-0dbb-413a-874f-868e1b0a3788","Type":"ContainerDied","Data":"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"}
Jul 25 00:49:01.376294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.376076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-svjf4" event={"ID":"c2aa041a-0dbb-413a-874f-868e1b0a3788","Type":"ContainerDied","Data":"cb739d79be98b504f22ebce4fbb1b9c945e1a052c517cf5b57464262a6db7984"}
Jul 25 00:49:01.376294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.376099    2574 scope.go:117] "RemoveContainer" containerID="267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"
Jul 25 00:49:01.384036 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.384013    2574 scope.go:117] "RemoveContainer" containerID="267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"
Jul 25 00:49:01.384299 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:01.384276    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb\": container with ID starting with 267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb not found: ID does not exist" containerID="267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"
Jul 25 00:49:01.384350 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.384312    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb"} err="failed to get container status \"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb\": rpc error: code = NotFound desc = could not find container \"267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb\": container with ID starting with 267b5ea467db54a5cebe4b2d3d5c6aaafa781588a92b7d302112f7292456fceb not found: ID does not exist"
Jul 25 00:49:01.394937 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.394899    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:49:01.396705 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:01.396684    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-svjf4"]
Jul 25 00:49:02.525932 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:02.525897    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2aa041a-0dbb-413a-874f-868e1b0a3788" path="/var/lib/kubelet/pods/c2aa041a-0dbb-413a-874f-868e1b0a3788/volumes"
Jul 25 00:49:05.551398 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.551364    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:05.551775 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.551683    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2aa041a-0dbb-413a-874f-868e1b0a3788" containerName="authorino"
Jul 25 00:49:05.551775 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.551693    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2aa041a-0dbb-413a-874f-868e1b0a3788" containerName="authorino"
Jul 25 00:49:05.551775 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.551735    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2aa041a-0dbb-413a-874f-868e1b0a3788" containerName="authorino"
Jul 25 00:49:05.556042 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.556025    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.558239 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.558217    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 25 00:49:05.558713 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.558698    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 25 00:49:05.559170 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.559148    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f5vw4\""
Jul 25 00:49:05.567602 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.567583    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:05.649188 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.649156    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.649387 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.649199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vmhc\" (UniqueName: \"kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.723160 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.723127    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:49:05.726318 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.726303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.736222 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.736197    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:49:05.749773 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.749750    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vmhc\" (UniqueName: \"kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.749873 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.749815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.752120 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.752103    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.756851 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.756833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vmhc\" (UniqueName: \"kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc\") pod \"maas-controller-5df8989964-dqh4f\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") " pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.851171 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.851090    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xdxx\" (UniqueName: \"kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.851171 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.851145    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.868047 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.868025    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:05.952642 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.952614    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xdxx\" (UniqueName: \"kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.952796 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.952666    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.955039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.955014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.960728 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.960708    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xdxx\" (UniqueName: \"kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx\") pod \"maas-controller-6cfc5bd855-jdlk8\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") " pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:05.993786 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:05.993759    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:05.996006 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:49:05.995979    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42d8471_3967_4c67_b4b0_2da0ea931b6b.slice/crio-cb0fab9a539091b26fd8e365167b96d616ab99a7f75768a81f388a7f417b3468 WatchSource:0}: Error finding container cb0fab9a539091b26fd8e365167b96d616ab99a7f75768a81f388a7f417b3468: Status 404 returned error can't find the container with id cb0fab9a539091b26fd8e365167b96d616ab99a7f75768a81f388a7f417b3468
Jul 25 00:49:06.035742 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:06.035710    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:06.160597 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:06.160572    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:49:06.163013 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:49:06.162991    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9f6748_ffb7_4665_aef4_44e4e5480fd6.slice/crio-4fbc16f75ec813c5d1f59acb5abc8fdc814670ee4d373b38e12639b77fa4aa3a WatchSource:0}: Error finding container 4fbc16f75ec813c5d1f59acb5abc8fdc814670ee4d373b38e12639b77fa4aa3a: Status 404 returned error can't find the container with id 4fbc16f75ec813c5d1f59acb5abc8fdc814670ee4d373b38e12639b77fa4aa3a
Jul 25 00:49:06.399691 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:06.399619    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8989964-dqh4f" event={"ID":"e42d8471-3967-4c67-b4b0-2da0ea931b6b","Type":"ContainerStarted","Data":"cb0fab9a539091b26fd8e365167b96d616ab99a7f75768a81f388a7f417b3468"}
Jul 25 00:49:06.400761 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:06.400740    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" event={"ID":"ec9f6748-ffb7-4665-aef4-44e4e5480fd6","Type":"ContainerStarted","Data":"4fbc16f75ec813c5d1f59acb5abc8fdc814670ee4d373b38e12639b77fa4aa3a"}
Jul 25 00:49:09.418438 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.418390    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8989964-dqh4f" event={"ID":"e42d8471-3967-4c67-b4b0-2da0ea931b6b","Type":"ContainerStarted","Data":"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"}
Jul 25 00:49:09.418938 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.418562    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:09.419875 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.419852    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" event={"ID":"ec9f6748-ffb7-4665-aef4-44e4e5480fd6","Type":"ContainerStarted","Data":"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"}
Jul 25 00:49:09.420004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.419968    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:09.452196 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.452144    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" podStartSLOduration=1.833148711 podStartE2EDuration="4.452127986s" totalImagesPullingTime="2.618979275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:49:09.451106996 +0000 UTC m=+789.498834991" watchObservedRunningTime="2026-07-25 00:49:09.452127986 +0000 UTC m=+789.499855980"
Jul 25 00:49:09.452799 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:09.452775    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5df8989964-dqh4f" podStartSLOduration=1.6725171140000001 podStartE2EDuration="4.452768959s" totalImagesPullingTime="2.780251845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:49:09.435163308 +0000 UTC m=+789.482891298" watchObservedRunningTime="2026-07-25 00:49:09.452768959 +0000 UTC m=+789.500496954"
Jul 25 00:49:20.426966 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.426929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:20.427462 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.427008    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:49:20.483881 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.483850    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:20.484068 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.484036    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5df8989964-dqh4f" podUID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" containerName="manager" containerID="cri-o://1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff" gracePeriod=30
Jul 25 00:49:20.730658 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.730635    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:20.880451 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.880416    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vmhc\" (UniqueName: \"kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc\") pod \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") "
Jul 25 00:49:20.880622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.880554    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert\") pod \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\" (UID: \"e42d8471-3967-4c67-b4b0-2da0ea931b6b\") "
Jul 25 00:49:20.882625 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.882593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e42d8471-3967-4c67-b4b0-2da0ea931b6b" (UID: "e42d8471-3967-4c67-b4b0-2da0ea931b6b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:49:20.882625 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.882612    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc" (OuterVolumeSpecName: "kube-api-access-9vmhc") pod "e42d8471-3967-4c67-b4b0-2da0ea931b6b" (UID: "e42d8471-3967-4c67-b4b0-2da0ea931b6b"). InnerVolumeSpecName "kube-api-access-9vmhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:49:20.981497 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.981408    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e42d8471-3967-4c67-b4b0-2da0ea931b6b-webhook-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:49:20.981497 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:20.981441    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vmhc\" (UniqueName: \"kubernetes.io/projected/e42d8471-3967-4c67-b4b0-2da0ea931b6b-kube-api-access-9vmhc\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:49:21.470662 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.470631    2574 generic.go:356] "Generic (PLEG): container finished" podID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" containerID="1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff" exitCode=0
Jul 25 00:49:21.471140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.470677    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5df8989964-dqh4f"
Jul 25 00:49:21.471140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.470724    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8989964-dqh4f" event={"ID":"e42d8471-3967-4c67-b4b0-2da0ea931b6b","Type":"ContainerDied","Data":"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"}
Jul 25 00:49:21.471140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.470783    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5df8989964-dqh4f" event={"ID":"e42d8471-3967-4c67-b4b0-2da0ea931b6b","Type":"ContainerDied","Data":"cb0fab9a539091b26fd8e365167b96d616ab99a7f75768a81f388a7f417b3468"}
Jul 25 00:49:21.471140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.470822    2574 scope.go:117] "RemoveContainer" containerID="1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"
Jul 25 00:49:21.479124 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.479108    2574 scope.go:117] "RemoveContainer" containerID="1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"
Jul 25 00:49:21.479414 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:21.479392    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff\": container with ID starting with 1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff not found: ID does not exist" containerID="1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"
Jul 25 00:49:21.479461 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.479423    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff"} err="failed to get container status \"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff\": rpc error: code = NotFound desc = could not find container \"1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff\": container with ID starting with 1dd96466ad000af59e131915e635caa4e04dccc0b9609ccf103cdba1f024baff not found: ID does not exist"
Jul 25 00:49:21.495805 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.492570    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:21.495805 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:21.495507    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5df8989964-dqh4f"]
Jul 25 00:49:22.521284 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:22.521209    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" path="/var/lib/kubelet/pods/e42d8471-3967-4c67-b4b0-2da0ea931b6b/volumes"
Jul 25 00:49:41.070402 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.070367    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"]
Jul 25 00:49:41.070819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.070688    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" containerName="manager"
Jul 25 00:49:41.070819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.070699    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" containerName="manager"
Jul 25 00:49:41.070819 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.070751    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42d8471-3967-4c67-b4b0-2da0ea931b6b" containerName="manager"
Jul 25 00:49:41.077807 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.077784    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.080348 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.080318    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 25 00:49:41.080472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.080390    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 25 00:49:41.080472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.080415    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 00:49:41.080472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.080395    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9j2xk\""
Jul 25 00:49:41.081319 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.081299    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"]
Jul 25 00:49:41.148167 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.148135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlvwt\" (UniqueName: \"kubernetes.io/projected/6761b827-2d52-407d-a84c-06db12c20573-kube-api-access-hlvwt\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.148335 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.148175    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6761b827-2d52-407d-a84c-06db12c20573-openshift-service-ca\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.148335 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.148264    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.249444 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.249406    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlvwt\" (UniqueName: \"kubernetes.io/projected/6761b827-2d52-407d-a84c-06db12c20573-kube-api-access-hlvwt\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.249444 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.249442    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6761b827-2d52-407d-a84c-06db12c20573-openshift-service-ca\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.249922 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.249625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.249922 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:41.249782    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 25 00:49:41.249922 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:41.249851    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls podName:6761b827-2d52-407d-a84c-06db12c20573 nodeName:}" failed. No retries permitted until 2026-07-25 00:49:41.749830401 +0000 UTC m=+821.797558383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls") pod "maas-api-54ccd5bb8c-f7795" (UID: "6761b827-2d52-407d-a84c-06db12c20573") : secret "maas-api-serving-cert" not found
Jul 25 00:49:41.250197 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.250181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6761b827-2d52-407d-a84c-06db12c20573-openshift-service-ca\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.257235 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.257217    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlvwt\" (UniqueName: \"kubernetes.io/projected/6761b827-2d52-407d-a84c-06db12c20573-kube-api-access-hlvwt\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.535409 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.535376    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"]
Jul 25 00:49:41.538928 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.538908    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.541196 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.541172    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 25 00:49:41.541294 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.541235    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fp5wk\""
Jul 25 00:49:41.550145 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.550118    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"]
Jul 25 00:49:41.653653 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.653621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2v8c\" (UniqueName: \"kubernetes.io/projected/aea7f9c4-7232-46d3-a46a-59b017bff6af-kube-api-access-s2v8c\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.653816 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.653666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aea7f9c4-7232-46d3-a46a-59b017bff6af-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.754248 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.754212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:41.754475 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.754324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2v8c\" (UniqueName: \"kubernetes.io/projected/aea7f9c4-7232-46d3-a46a-59b017bff6af-kube-api-access-s2v8c\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.754475 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.754364    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aea7f9c4-7232-46d3-a46a-59b017bff6af-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.754475 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:41.754369    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 25 00:49:41.754475 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:49:41.754447    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls podName:6761b827-2d52-407d-a84c-06db12c20573 nodeName:}" failed. No retries permitted until 2026-07-25 00:49:42.754428684 +0000 UTC m=+822.802156657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls") pod "maas-api-54ccd5bb8c-f7795" (UID: "6761b827-2d52-407d-a84c-06db12c20573") : secret "maas-api-serving-cert" not found
Jul 25 00:49:41.755153 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.755127    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aea7f9c4-7232-46d3-a46a-59b017bff6af-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.764539 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.764512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2v8c\" (UniqueName: \"kubernetes.io/projected/aea7f9c4-7232-46d3-a46a-59b017bff6af-kube-api-access-s2v8c\") pod \"payload-pre-processing-687dbb6cf6-c2pff\" (UID: \"aea7f9c4-7232-46d3-a46a-59b017bff6af\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.850807 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.850724    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:41.982545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:41.982480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"]
Jul 25 00:49:41.985199 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:49:41.985171    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea7f9c4_7232_46d3_a46a_59b017bff6af.slice/crio-680837fcf792a56725df67c4abe5f121093914518c5a8f7aa04dde83f2e2843a WatchSource:0}: Error finding container 680837fcf792a56725df67c4abe5f121093914518c5a8f7aa04dde83f2e2843a: Status 404 returned error can't find the container with id 680837fcf792a56725df67c4abe5f121093914518c5a8f7aa04dde83f2e2843a
Jul 25 00:49:42.562152 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:42.562102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff" event={"ID":"aea7f9c4-7232-46d3-a46a-59b017bff6af","Type":"ContainerStarted","Data":"680837fcf792a56725df67c4abe5f121093914518c5a8f7aa04dde83f2e2843a"}
Jul 25 00:49:42.778290 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:42.777683    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:42.781268 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:42.781178    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6761b827-2d52-407d-a84c-06db12c20573-maas-api-tls\") pod \"maas-api-54ccd5bb8c-f7795\" (UID: \"6761b827-2d52-407d-a84c-06db12c20573\") " pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:42.889320 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:42.889216    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:43.073273 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:43.073234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"]
Jul 25 00:49:43.077809 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:49:43.077612    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6761b827_2d52_407d_a84c_06db12c20573.slice/crio-473d08517ccf4618ae0dddd8d3130e37230cdc15ff8347dc9495cd9879e46d5e WatchSource:0}: Error finding container 473d08517ccf4618ae0dddd8d3130e37230cdc15ff8347dc9495cd9879e46d5e: Status 404 returned error can't find the container with id 473d08517ccf4618ae0dddd8d3130e37230cdc15ff8347dc9495cd9879e46d5e
Jul 25 00:49:43.573645 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:43.573601    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795" event={"ID":"6761b827-2d52-407d-a84c-06db12c20573","Type":"ContainerStarted","Data":"473d08517ccf4618ae0dddd8d3130e37230cdc15ff8347dc9495cd9879e46d5e"}
Jul 25 00:49:45.585928 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:45.585889    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff" event={"ID":"aea7f9c4-7232-46d3-a46a-59b017bff6af","Type":"ContainerStarted","Data":"03aad76b8fe80e5a3c2986506b1ce0c62375a353be293375d9cdee25e78ea310"}
Jul 25 00:49:45.586352 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:45.586246    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:49:45.601538 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:45.601495    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff" podStartSLOduration=1.6769896960000001 podStartE2EDuration="4.601476855s" totalImagesPullingTime="2.924487159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:49:45.599995621 +0000 UTC m=+825.647723618" watchObservedRunningTime="2026-07-25 00:49:45.601476855 +0000 UTC m=+825.649204852"
Jul 25 00:49:46.592484 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:46.592447    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795" event={"ID":"6761b827-2d52-407d-a84c-06db12c20573","Type":"ContainerStarted","Data":"f8593bcb1995991ac21a4e6f66c3b7fd71dad86a6a62340e0db00f1a412e7713"}
Jul 25 00:49:46.610183 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:46.610131    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795" podStartSLOduration=2.510926516 podStartE2EDuration="5.610114159s" totalImagesPullingTime="3.099187643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:49:46.609618866 +0000 UTC m=+826.657346861" watchObservedRunningTime="2026-07-25 00:49:46.610114159 +0000 UTC m=+826.657842179"
Jul 25 00:49:47.605453 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:47.605425    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:49.615204 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.615124    2574 generic.go:356] "Generic (PLEG): container finished" podID="03888453-1ee8-4de2-962f-3a9266354cd5" containerID="7664d5ef7bbba8ac02865f8a87fa2182f38cd1b6f923e6a55976c7fb4d896291" exitCode=0
Jul 25 00:49:49.615604 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.615196    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" event={"ID":"03888453-1ee8-4de2-962f-3a9266354cd5","Type":"ContainerDied","Data":"7664d5ef7bbba8ac02865f8a87fa2182f38cd1b6f923e6a55976c7fb4d896291"}
Jul 25 00:49:49.615604 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.615569    2574 scope.go:117] "RemoveContainer" containerID="7664d5ef7bbba8ac02865f8a87fa2182f38cd1b6f923e6a55976c7fb4d896291"
Jul 25 00:49:49.616578 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.616551    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:49:49.616690 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.616625    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:49:49.616690 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:49.616656    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 00:49:50.199991 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:50.199963    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:49:50.620514 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:50.620476    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" event={"ID":"03888453-1ee8-4de2-962f-3a9266354cd5","Type":"ContainerStarted","Data":"2098726b94d1ac6f9b57b2fddbea96abda06fd87ae1379ae55dfa34e7c23b01d"}
Jul 25 00:49:51.018343 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:51.018307    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:49:51.019472 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:51.019448    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wbcf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 25 00:49:51.019584 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:51.019504    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" podUID="03888453-1ee8-4de2-962f-3a9266354cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 25 00:49:52.018128 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:52.018095    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wbcf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 25 00:49:52.018519 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:52.018149    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" podUID="03888453-1ee8-4de2-962f-3a9266354cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 25 00:49:53.018298 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:53.018262    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wbcf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 25 00:49:53.018692 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:53.018315    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" podUID="03888453-1ee8-4de2-962f-3a9266354cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 25 00:49:53.614401 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:53.614370    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54ccd5bb8c-f7795"
Jul 25 00:49:54.017777 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:54.017737    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wbcf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 25 00:49:54.017961 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:54.017797    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5" podUID="03888453-1ee8-4de2-962f-3a9266354cd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 25 00:49:55.022545 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:55.022506    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:49:55.022956 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:55.022789    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:49:55.023443 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:55.023421    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wbcf5"
Jul 25 00:49:56.595039 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:49:56.595009    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-c2pff"
Jul 25 00:50:23.094507 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.094472    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"]
Jul 25 00:50:23.099458 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.099435    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.101619 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.101597    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 25 00:50:23.102533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.102503    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 25 00:50:23.102533 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.102514    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gjm4r\""
Jul 25 00:50:23.103301 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.103136    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 25 00:50:23.105028 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.105006    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"]
Jul 25 00:50:23.138513 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138481    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.138676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.138676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138601    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.138676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138625    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9kpd\" (UniqueName: \"kubernetes.io/projected/9f21e0da-9779-47ef-a347-761e61cb809b-kube-api-access-p9kpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.138676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138665    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.138837 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.138758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f21e0da-9779-47ef-a347-761e61cb809b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239198 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239165    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239198 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239202    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9kpd\" (UniqueName: \"kubernetes.io/projected/9f21e0da-9779-47ef-a347-761e61cb809b-kube-api-access-p9kpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239433 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239433 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f21e0da-9779-47ef-a347-761e61cb809b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239433 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239316    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239433 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239701 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239678    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239746 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.239783 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.239760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.241529 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.241507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9f21e0da-9779-47ef-a347-761e61cb809b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.241780 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.241761    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f21e0da-9779-47ef-a347-761e61cb809b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.246325 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.246306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9kpd\" (UniqueName: \"kubernetes.io/projected/9f21e0da-9779-47ef-a347-761e61cb809b-kube-api-access-p9kpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-r7cfj\" (UID: \"9f21e0da-9779-47ef-a347-761e61cb809b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.411259 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.411176    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:23.540479 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.540449    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"]
Jul 25 00:50:23.543539 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:50:23.543507    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f21e0da_9779_47ef_a347_761e61cb809b.slice/crio-dcf9b5e80cdb397a7dabb9366c64079b0a32d01188306ab313cdd8909cfef7dd WatchSource:0}: Error finding container dcf9b5e80cdb397a7dabb9366c64079b0a32d01188306ab313cdd8909cfef7dd: Status 404 returned error can't find the container with id dcf9b5e80cdb397a7dabb9366c64079b0a32d01188306ab313cdd8909cfef7dd
Jul 25 00:50:23.767778 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:23.767731    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj" event={"ID":"9f21e0da-9779-47ef-a347-761e61cb809b","Type":"ContainerStarted","Data":"dcf9b5e80cdb397a7dabb9366c64079b0a32d01188306ab313cdd8909cfef7dd"}
Jul 25 00:50:24.774140 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:24.774044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj" event={"ID":"9f21e0da-9779-47ef-a347-761e61cb809b","Type":"ContainerStarted","Data":"e5535fd737473b2c03b1fd4497444df4b95da63b97e1cb1bd474d35ea2806989"}
Jul 25 00:50:24.790725 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:24.790669    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj" podStartSLOduration=0.873437755 podStartE2EDuration="1.790654541s" totalImagesPullingTime="917.216786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:50:24.7894472 +0000 UTC m=+864.837175195" watchObservedRunningTime="2026-07-25 00:50:24.790654541 +0000 UTC m=+864.838382536"
Jul 25 00:50:31.679428 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.679391    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"]
Jul 25 00:50:31.682800 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.682777    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.685232 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.685209    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 25 00:50:31.692634 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.692611    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"]
Jul 25 00:50:31.817263 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817228    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.817263 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817273    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.817477 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sx8w\" (UniqueName: \"kubernetes.io/projected/ae84549c-d465-4199-b8dd-fa36d57cff02-kube-api-access-4sx8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.817477 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817387    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.817477 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817444    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.817572 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.817484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae84549c-d465-4199-b8dd-fa36d57cff02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.918817 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918781    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.918817 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sx8w\" (UniqueName: \"kubernetes.io/projected/ae84549c-d465-4199-b8dd-fa36d57cff02-kube-api-access-4sx8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918888    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918936    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.918980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae84549c-d465-4199-b8dd-fa36d57cff02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919303 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.919281    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919355 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.919337    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.919445 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.919424    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.921254 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.921235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae84549c-d465-4199-b8dd-fa36d57cff02-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.921349 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.921333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae84549c-d465-4199-b8dd-fa36d57cff02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.925626 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.925600    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sx8w\" (UniqueName: \"kubernetes.io/projected/ae84549c-d465-4199-b8dd-fa36d57cff02-kube-api-access-4sx8w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gf74r\" (UID: \"ae84549c-d465-4199-b8dd-fa36d57cff02\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:31.993641 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:31.993618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:32.118840 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:32.118814    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"]
Jul 25 00:50:32.120919 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:50:32.120892    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae84549c_d465_4199_b8dd_fa36d57cff02.slice/crio-c9b3fd116d9d044c10e762073c7efde4f9852d7f0542fc31590b0dc907d5b4f9 WatchSource:0}: Error finding container c9b3fd116d9d044c10e762073c7efde4f9852d7f0542fc31590b0dc907d5b4f9: Status 404 returned error can't find the container with id c9b3fd116d9d044c10e762073c7efde4f9852d7f0542fc31590b0dc907d5b4f9
Jul 25 00:50:32.810534 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:32.810496    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r" event={"ID":"ae84549c-d465-4199-b8dd-fa36d57cff02","Type":"ContainerStarted","Data":"cf45c5a9b90fb2a944ea59fe9feeae579d2c75bbce601b95c33032f798f1cda8"}
Jul 25 00:50:32.811034 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:32.810565    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r" event={"ID":"ae84549c-d465-4199-b8dd-fa36d57cff02","Type":"ContainerStarted","Data":"c9b3fd116d9d044c10e762073c7efde4f9852d7f0542fc31590b0dc907d5b4f9"}
Jul 25 00:50:32.825622 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:32.825571    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r" podStartSLOduration=1.644365434 podStartE2EDuration="1.825555962s" totalImagesPullingTime="181.190528ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:50:32.824496767 +0000 UTC m=+872.872224761" watchObservedRunningTime="2026-07-25 00:50:32.825555962 +0000 UTC m=+872.873283956"
Jul 25 00:50:33.411304 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:33.411265    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:33.411476 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:33.411327    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:33.423573 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:33.423548    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:33.825501 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:33.825470    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-r7cfj"
Jul 25 00:50:41.994098 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:41.994049    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:41.994542 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:41.994138    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:42.006876 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:42.006849    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:42.870973 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:42.870944    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gf74r"
Jul 25 00:50:58.096883 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.096800    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"]
Jul 25 00:50:58.101370 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.101348    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.103670 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.103640    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 25 00:50:58.108361 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.108334    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"]
Jul 25 00:50:58.259079 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.259244 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259093    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f83b4310-9728-442d-bbff-0774a9438af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.259244 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.259244 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259137    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp2qq\" (UniqueName: \"kubernetes.io/projected/f83b4310-9728-442d-bbff-0774a9438af9-kube-api-access-rp2qq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.259244 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.259244 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.259205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360372 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f83b4310-9728-442d-bbff-0774a9438af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360599 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360599 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360408    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp2qq\" (UniqueName: \"kubernetes.io/projected/f83b4310-9728-442d-bbff-0774a9438af9-kube-api-access-rp2qq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360599 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360599 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360474    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360805 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360722    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360863 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360831    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.360921 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.360878    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.362672 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.362655    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f83b4310-9728-442d-bbff-0774a9438af9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.362951 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.362930    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f83b4310-9728-442d-bbff-0774a9438af9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.369537 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.369516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp2qq\" (UniqueName: \"kubernetes.io/projected/f83b4310-9728-442d-bbff-0774a9438af9-kube-api-access-rp2qq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dr9p8\" (UID: \"f83b4310-9728-442d-bbff-0774a9438af9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.435451 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.435410    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:50:58.570049 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.570023    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"]
Jul 25 00:50:58.572162 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:50:58.572132    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83b4310_9728_442d_bbff_0774a9438af9.slice/crio-026f5079ea9a20e8c6b3e3876e0cf449b6722149d22584d4592b9f3ecd1e0545 WatchSource:0}: Error finding container 026f5079ea9a20e8c6b3e3876e0cf449b6722149d22584d4592b9f3ecd1e0545: Status 404 returned error can't find the container with id 026f5079ea9a20e8c6b3e3876e0cf449b6722149d22584d4592b9f3ecd1e0545
Jul 25 00:50:58.926339 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.926303    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8" event={"ID":"f83b4310-9728-442d-bbff-0774a9438af9","Type":"ContainerStarted","Data":"59dbd18c3ea4f282c1d24f47f217738e7b4652824cef9f713af3b0d3e720d103"}
Jul 25 00:50:58.926520 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.926359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8" event={"ID":"f83b4310-9728-442d-bbff-0774a9438af9","Type":"ContainerStarted","Data":"026f5079ea9a20e8c6b3e3876e0cf449b6722149d22584d4592b9f3ecd1e0545"}
Jul 25 00:50:58.943944 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:50:58.943894    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8" podStartSLOduration=0.782587326 podStartE2EDuration="943.87591ms" totalImagesPullingTime="161.288584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:50:58.941409343 +0000 UTC m=+898.989137351" watchObservedRunningTime="2026-07-25 00:50:58.94387591 +0000 UTC m=+898.991603905"
Jul 25 00:51:08.436286 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:08.436239    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:51:08.436780 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:08.436330    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:51:08.449033 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:08.449007    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:51:08.984613 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:08.984583    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dr9p8"
Jul 25 00:51:23.785434 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.785388    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"]
Jul 25 00:51:23.789801 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.789775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.792050 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.792024    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 25 00:51:23.799117 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.799089    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"]
Jul 25 00:51:23.872404 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872368    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db2082f-e60c-4aa5-9a18-b17bee674160-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.872404 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.872598 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872420    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.872598 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.872598 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872554    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.872598 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.872575    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jm9\" (UniqueName: \"kubernetes.io/projected/5db2082f-e60c-4aa5-9a18-b17bee674160-kube-api-access-q4jm9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973732 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973701    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db2082f-e60c-4aa5-9a18-b17bee674160-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973738    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973756    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973808    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.973908 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.973831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jm9\" (UniqueName: \"kubernetes.io/projected/5db2082f-e60c-4aa5-9a18-b17bee674160-kube-api-access-q4jm9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.974250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.974207    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.974250 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.974234    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.974396 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.974280    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.976156 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.976139    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5db2082f-e60c-4aa5-9a18-b17bee674160-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.976237 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.976221    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5db2082f-e60c-4aa5-9a18-b17bee674160-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:23.980565 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:23.980546    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jm9\" (UniqueName: \"kubernetes.io/projected/5db2082f-e60c-4aa5-9a18-b17bee674160-kube-api-access-q4jm9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z\" (UID: \"5db2082f-e60c-4aa5-9a18-b17bee674160\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:24.101042 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:24.100952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:24.234877 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:24.234856    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"]
Jul 25 00:51:24.237039 ip-10-0-136-9 kubenswrapper[2574]: W0725 00:51:24.237009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5db2082f_e60c_4aa5_9a18_b17bee674160.slice/crio-c163497a433f859c21961aef24afc3a6db4b78de2a8bf9a9009ecc5e630252b1 WatchSource:0}: Error finding container c163497a433f859c21961aef24afc3a6db4b78de2a8bf9a9009ecc5e630252b1: Status 404 returned error can't find the container with id c163497a433f859c21961aef24afc3a6db4b78de2a8bf9a9009ecc5e630252b1
Jul 25 00:51:25.048218 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:25.048177    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z" event={"ID":"5db2082f-e60c-4aa5-9a18-b17bee674160","Type":"ContainerStarted","Data":"22b30d6c8a6d707d648adbcfb14bd17e8e20365b267a874db357d48ba5543117"}
Jul 25 00:51:25.048218 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:25.048221    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z" event={"ID":"5db2082f-e60c-4aa5-9a18-b17bee674160","Type":"ContainerStarted","Data":"c163497a433f859c21961aef24afc3a6db4b78de2a8bf9a9009ecc5e630252b1"}
Jul 25 00:51:25.065022 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:25.064960    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z" podStartSLOduration=1.9044201410000001 podStartE2EDuration="2.06493476s" totalImagesPullingTime="160.514619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 00:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 00:51:25.062969026 +0000 UTC m=+925.110697020" watchObservedRunningTime="2026-07-25 00:51:25.06493476 +0000 UTC m=+925.112662755"
Jul 25 00:51:34.101665 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:34.101633    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:34.102228 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:34.101692    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:34.114246 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:34.114218    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:51:35.104155 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:51:35.104121    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z"
Jul 25 00:53:10.399972 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.399936    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:53:10.400524 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.400152    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerName="manager" containerID="cri-o://f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d" gracePeriod=30
Jul 25 00:53:10.425482 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.425453    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.28:8081/readyz\": dial tcp 10.133.0.28:8081: connect: connection refused"
Jul 25 00:53:10.648255 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.648228    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:53:10.715473 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.715447    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xdxx\" (UniqueName: \"kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx\") pod \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") "
Jul 25 00:53:10.715644 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.715495    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert\") pod \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\" (UID: \"ec9f6748-ffb7-4665-aef4-44e4e5480fd6\") "
Jul 25 00:53:10.717580 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.717548    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec9f6748-ffb7-4665-aef4-44e4e5480fd6" (UID: "ec9f6748-ffb7-4665-aef4-44e4e5480fd6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 00:53:10.717580 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.717564    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx" (OuterVolumeSpecName: "kube-api-access-8xdxx") pod "ec9f6748-ffb7-4665-aef4-44e4e5480fd6" (UID: "ec9f6748-ffb7-4665-aef4-44e4e5480fd6"). InnerVolumeSpecName "kube-api-access-8xdxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 00:53:10.817204 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.817168    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xdxx\" (UniqueName: \"kubernetes.io/projected/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-kube-api-access-8xdxx\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:53:10.817204 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:10.817198    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec9f6748-ffb7-4665-aef4-44e4e5480fd6-webhook-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 00:53:11.510516 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.510480    2574 generic.go:356] "Generic (PLEG): container finished" podID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerID="f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d" exitCode=0
Jul 25 00:53:11.510965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.510536    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8"
Jul 25 00:53:11.510965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.510566    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" event={"ID":"ec9f6748-ffb7-4665-aef4-44e4e5480fd6","Type":"ContainerDied","Data":"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"}
Jul 25 00:53:11.510965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.510625    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cfc5bd855-jdlk8" event={"ID":"ec9f6748-ffb7-4665-aef4-44e4e5480fd6","Type":"ContainerDied","Data":"4fbc16f75ec813c5d1f59acb5abc8fdc814670ee4d373b38e12639b77fa4aa3a"}
Jul 25 00:53:11.510965 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.510652    2574 scope.go:117] "RemoveContainer" containerID="f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"
Jul 25 00:53:11.520390 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.520377    2574 scope.go:117] "RemoveContainer" containerID="f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"
Jul 25 00:53:11.520627 ip-10-0-136-9 kubenswrapper[2574]: E0725 00:53:11.520611    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d\": container with ID starting with f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d not found: ID does not exist" containerID="f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"
Jul 25 00:53:11.520676 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.520633    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d"} err="failed to get container status \"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d\": rpc error: code = NotFound desc = could not find container \"f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d\": container with ID starting with f5aeb02d17f67693b3fc008c396fb9e4b7e94eb31a8340394b4c48725657f37d not found: ID does not exist"
Jul 25 00:53:11.532330 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.532310    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:53:11.536004 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:11.535983    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cfc5bd855-jdlk8"]
Jul 25 00:53:12.520502 ip-10-0-136-9 kubenswrapper[2574]: I0725 00:53:12.520470    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" path="/var/lib/kubelet/pods/ec9f6748-ffb7-4665-aef4-44e4e5480fd6/volumes"
Jul 25 01:00:31.580824 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:31.580777    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-25T01:00:21Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-25T01:00:21Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-25T01:00:21Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-25T01:00:21Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-136-9.ec2.internal\": Patch \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-9.ec2.internal/status?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:00:32.381127 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:32.381081    2574 controller.go:195] "Failed to update lease" err="Put \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 25 01:00:41.581270 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:41.581223    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": Get \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-9.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 25 01:00:42.381469 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:42.381425    2574 controller.go:195] "Failed to update lease" err="Put \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 25 01:00:51.581650 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:51.581609    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": Get \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:00:52.382411 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:00:52.382367    2574 controller.go:195] "Failed to update lease" err="Put \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:01:01.582351 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:01:01.582308    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-9.ec2.internal\": Get \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-136-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:01:02.383538 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:01:02.383478    2574 controller.go:195] "Failed to update lease" err="Put \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:01:04.920849 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920805    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.920849 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920834    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rcwf8\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920834    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sp8wb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920878    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920884    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920906    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920920    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920931    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920958    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920977    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:01:04.920992    2574 controller.go:195] "Failed to update lease" err="Put \"https://a3a774fc6e4a14210a7052df5311a846-85ee8da77f2aef71.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-9.ec2.internal?timeout=10s\": http2: client connection lost"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921010    2574 controller.go:115] "failed to update lease using latest lease, fallback to ensure lease" err="failed 5 attempts to update lease"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921026    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9j2xk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921046    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.920996    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921092    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fp5wk\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921102    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921122    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921126    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921127    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-agent\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.921381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921155    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921182    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921183    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921190    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921205    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921228    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921233    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921245    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5x988\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921250    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921281    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921290    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9qz72\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921306    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9lhzw\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921314    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921330    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921314    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921354    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921373    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921205    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921396    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921408    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921428    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921443    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921450    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921456    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921471    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2m9l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921480    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921487    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bwdnp\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921497    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921504    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-dockercfg-cn99w\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921515    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921517    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921533    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921541    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921566    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921569    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921580    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.922888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921579    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921580    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921605    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921611    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921614    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921619    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921642    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921650    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wtgwf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921658    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921667    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921677    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2fdkv\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921688    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921702    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921714    2574 reflector.go:571] "Warning: watch ended with error" reflector="pkg/kubelet/config/apiserver.go:66" type="*v1.Pod" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921721    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921747    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921753    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921755    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921772    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xdtb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921777    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921792    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"default-dockercfg-gjm4r\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921806    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921817    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qpwxd\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921833    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qmns7\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921805    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921850    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921862    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921867    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vl845\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921871    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921809    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921835    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921805    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921890    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921869    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921874    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921910    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.923988 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921872    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"default-dockercfg-4jgts\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921921    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921906    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vq97v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921933    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921938    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kube-system\"/\"original-pull-secret\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921837    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921910    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921905    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-spqtb\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921919    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921998    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921830    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922010    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cpcs4k007mg2l\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922015    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rg2k4\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921957    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922025    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921927    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921940    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nql9s\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921971    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6x25j\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.924730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922050    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921972    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921978    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921889    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922096    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921995    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921943    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922112    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921999    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8r4pz\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922010    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922015    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922129    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kt6t\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921964    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4db2\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922050    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922070    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922073    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vsx9v\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922158    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922164    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.925555 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922090    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922176    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922100    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922120    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921957    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sv9bh\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922128    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7sgxr\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921956    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b9r7q\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922133    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922138    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b8ptf\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922152    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922160    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.922049    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921972    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:04.926321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:04.921991    2574 reflector.go:571] "Warning: watch ended with error" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" err="an error on the server (\"unable to decode an event from the watch stream: http2: client connection lost\") has prevented the request from succeeding"
Jul 25 01:01:05.725562 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.725530    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 25 01:01:05.726720 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.726707    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 25 01:01:05.734972 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.734955    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6x25j\""
Jul 25 01:01:05.736006 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.735993    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 25 01:01:05.742178 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.742163    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7xdtb\""
Jul 25 01:01:05.755584 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.755565    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 25 01:01:05.757657 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.757642    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 25 01:01:05.773167 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.773144    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 25 01:01:05.779305 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.779289    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 25 01:01:05.780322 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.780306    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.782492 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.782477    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bwdnp\""
Jul 25 01:01:05.782763 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.782748    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 25 01:01:05.794959 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.794937    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qpwxd\""
Jul 25 01:01:05.798330 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.798305    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 25 01:01:05.798998 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.798984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 25 01:01:05.799229 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.799209    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.802247 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.802234    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 25 01:01:05.812487 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.812472    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 25 01:01:05.814662 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.814650    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 25 01:01:05.819937 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.819923    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 25 01:01:05.820035 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.820016    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:01:05.835755 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.835737    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.838009 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.837994    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fp5wk\""
Jul 25 01:01:05.843169 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.843155    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 25 01:01:05.851262 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.851245    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 25 01:01:05.855406 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.855379    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 25 01:01:05.857495 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.857481    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9kt6t\""
Jul 25 01:01:05.863736 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.863721    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gjm4r\""
Jul 25 01:01:05.881042 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.881024    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 25 01:01:05.909214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.909190    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 25 01:01:05.914419 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.914397    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 25 01:01:05.925024 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.925001    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientMemory"
Jul 25 01:01:05.925354 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.925031    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasNoDiskPressure"
Jul 25 01:01:05.925354 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.925041    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeHasSufficientPID"
Jul 25 01:01:05.925354 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.925064    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-9.ec2.internal" event="NodeReady"
Jul 25 01:01:05.928238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.928222    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 25 01:01:05.929224 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.929209    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 25 01:01:05.937656 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.937641    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.939097 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.939081    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 25 01:01:05.948535 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.948504    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 25 01:01:05.951379 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.951359    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 25 01:01:05.954745 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.954722    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 25 01:01:05.954834 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.954791    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 25 01:01:05.960320 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.960302    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 25 01:01:05.962127 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.962112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sp8wb\""
Jul 25 01:01:05.963703 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.963685    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 25 01:01:05.966409 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.966392    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.972615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.972598    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 25 01:01:05.980742 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.980686    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 25 01:01:05.987376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.987361    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 25 01:01:05.995727 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:05.995711    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.002169 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.002147    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qmns7\""
Jul 25 01:01:06.006504 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.006488    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 25 01:01:06.009613 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.009598    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 25 01:01:06.035039 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.035016    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.041487 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.041473    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 25 01:01:06.043641 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.043626    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 25 01:01:06.048661 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.048647    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b2m9l\""
Jul 25 01:01:06.054965 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.054940    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.059344 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.059329    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.068529 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.068513    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 25 01:01:06.076289 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.076271    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 25 01:01:06.077368 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.077354    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.077423 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.077358    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.078242 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.078225    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.081948 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.081933    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 25 01:01:06.083019 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.083005    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 25 01:01:06.088420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.088405    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 25 01:01:06.098690 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.098672    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 25 01:01:06.099670 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.099657    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4jgts\""
Jul 25 01:01:06.100730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.100713    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2fdkv\""
Jul 25 01:01:06.100775 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.100735    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b8ptf\""
Jul 25 01:01:06.106731 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.106714    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 25 01:01:06.106778 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.106747    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 25 01:01:06.109992 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.109977    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.110052 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.110039    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 25 01:01:06.114088 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.114075    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 25 01:01:06.116002 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.115989    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 25 01:01:06.116178 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.116164    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 25 01:01:06.116249 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.116230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 25 01:01:06.117756 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.117736    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.119611 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.119598    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:01:06.124801 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.124776    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cpcs4k007mg2l\""
Jul 25 01:01:06.128660 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.128641    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9lhzw\""
Jul 25 01:01:06.132614 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.132597    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:01:06.132723 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.132601    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b9r7q\""
Jul 25 01:01:06.152010 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.151993    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vq97v\""
Jul 25 01:01:06.155170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.155155    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vl845\""
Jul 25 01:01:06.161311 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.161291    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.163309 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.163294    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-spqtb\""
Jul 25 01:01:06.179438 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.179419    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.187701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.187686    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9qz72\""
Jul 25 01:01:06.188119 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.188104    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 25 01:01:06.196404 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.196386    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.209191 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.209164    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 25 01:01:06.211240 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.211224    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.217245 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.217230    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.233717 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.233661    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 25 01:01:06.235839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.235823    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 25 01:01:06.239003 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.238986    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wtgwf\""
Jul 25 01:01:06.244037 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.244022    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 25 01:01:06.248225 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.248201    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 25 01:01:06.269663 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.269645    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.270531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.270517    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.271645 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.271630    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.275626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.275611    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 25 01:01:06.303230 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.303207    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.304052 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.304037    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8r4pz\""
Jul 25 01:01:06.305317 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.305303    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.313731 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.313714    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nql9s\""
Jul 25 01:01:06.333313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.333294    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.344628 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.344610    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 25 01:01:06.351791 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.351774    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.369186 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.369170    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.381677 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.381661    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.382748 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.382735    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.385818 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.385805    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.392983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.392967    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.394203 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.394178    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 25 01:01:06.396111 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.396095    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 25 01:01:06.397014 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.396997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 25 01:01:06.400965 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.400951    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4db2\""
Jul 25 01:01:06.404169 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.404153    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7sgxr\""
Jul 25 01:01:06.408305 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.408289    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.423486 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.423469    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 25 01:01:06.425645 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.425629    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 25 01:01:06.432953 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.432934    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 25 01:01:06.434790 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.434772    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vsx9v\""
Jul 25 01:01:06.436643 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.436630    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 25 01:01:06.451906 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.451889    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 25 01:01:06.457369 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.457352    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.464731 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.464715    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 25 01:01:06.472903 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.472888    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5x988\""
Jul 25 01:01:06.479810 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.479795    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 25 01:01:06.484207 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.484160    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9j2xk\""
Jul 25 01:01:06.485125 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.485112    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rg2k4\""
Jul 25 01:01:06.485191 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.485117    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 25 01:01:06.488087 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.488071    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rcwf8\""
Jul 25 01:01:06.501928 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.501909    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.504500 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.504481    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 25 01:01:06.512702 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.512684    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 25 01:01:06.512784 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.512718    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cn99w\""
Jul 25 01:01:06.522445 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.522420    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 25 01:01:06.525413 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:01:06.525398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sv9bh\""
Jul 25 01:04:34.389126 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.389015    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:04:34.389596 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.389526    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerName="manager"
Jul 25 01:04:34.389596 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.389541    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerName="manager"
Jul 25 01:04:34.389672 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.389619    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9f6748-ffb7-4665-aef4-44e4e5480fd6" containerName="manager"
Jul 25 01:04:34.392572 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.392556    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.395490 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.395468    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-b59a4a38-kserve-self-signed-certs\""
Jul 25 01:04:34.402284 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.402264    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:04:34.490211 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490170    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.490407 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.490407 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490325    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.490407 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490348    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.490407 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490374    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.490591 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.490409    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qvxh\" (UniqueName: \"kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591548 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591511    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591645    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.591767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.591699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qvxh\" (UniqueName: \"kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.592171 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.592136    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.592171 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.592162    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.592337 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.592195    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.593926 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.593900    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.594041 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.594025    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.600759 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.600740    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qvxh\" (UniqueName: \"kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh\") pod \"e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") " pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.702189 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.702112    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:34.840022 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:34.839879    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:04:34.842998 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:04:34.842964    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd073a44_83be_46ac_b226_c19cae15bda6.slice/crio-70e07e419b0c5de60fee8783cbfcb7e3d2d20547e23c05849e5b7ef74dd1a250 WatchSource:0}: Error finding container 70e07e419b0c5de60fee8783cbfcb7e3d2d20547e23c05849e5b7ef74dd1a250: Status 404 returned error can't find the container with id 70e07e419b0c5de60fee8783cbfcb7e3d2d20547e23c05849e5b7ef74dd1a250
Jul 25 01:04:35.495736 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:35.495697    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" event={"ID":"cd073a44-83be-46ac-b226-c19cae15bda6","Type":"ContainerStarted","Data":"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"}
Jul 25 01:04:35.495736 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:35.495742    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" event={"ID":"cd073a44-83be-46ac-b226-c19cae15bda6","Type":"ContainerStarted","Data":"70e07e419b0c5de60fee8783cbfcb7e3d2d20547e23c05849e5b7ef74dd1a250"}
Jul 25 01:04:35.513768 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:35.513723    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" podStartSLOduration=1.51370859 podStartE2EDuration="1.51370859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:04:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:04:35.513290724 +0000 UTC m=+1715.561018719" watchObservedRunningTime="2026-07-25 01:04:35.51370859 +0000 UTC m=+1715.561436585"
Jul 25 01:04:44.702605 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:44.702572    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:44.703042 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:44.702618    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:44.717771 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:44.717741    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:04:45.548901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:04:45.548865    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:05:21.974110 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:21.974076    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:05:36.992715 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:36.992673    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" podUID="cd073a44-83be-46ac-b226-c19cae15bda6" containerName="main" containerID="cri-o://544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5" gracePeriod=45
Jul 25 01:05:37.238092 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.238068    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:05:37.347045 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.346956    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347075    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qvxh\" (UniqueName: \"kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347122    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347142    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347170    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347213    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home\") pod \"cd073a44-83be-46ac-b226-c19cae15bda6\" (UID: \"cd073a44-83be-46ac-b226-c19cae15bda6\") "
Jul 25 01:05:37.347491 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347393    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache" (OuterVolumeSpecName: "model-cache") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:05:37.347491 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347406    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:05:37.347591 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347535    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home" (OuterVolumeSpecName: "home") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:05:37.347591 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347552    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.347591 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.347585    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.349308 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.349282    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm" (OuterVolumeSpecName: "dshm") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:05:37.349393 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.349300    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh" (OuterVolumeSpecName: "kube-api-access-6qvxh") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "kube-api-access-6qvxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:05:37.349393 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.349348    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cd073a44-83be-46ac-b226-c19cae15bda6" (UID: "cd073a44-83be-46ac-b226-c19cae15bda6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:05:37.448357 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.448311    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.448357 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.448351    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd073a44-83be-46ac-b226-c19cae15bda6-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.448357 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.448363    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd073a44-83be-46ac-b226-c19cae15bda6-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.448357 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.448373    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qvxh\" (UniqueName: \"kubernetes.io/projected/cd073a44-83be-46ac-b226-c19cae15bda6-kube-api-access-6qvxh\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:05:37.774622 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.774582    2574 generic.go:356] "Generic (PLEG): container finished" podID="cd073a44-83be-46ac-b226-c19cae15bda6" containerID="544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5" exitCode=0
Jul 25 01:05:37.774839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.774630    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"
Jul 25 01:05:37.774839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.774669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" event={"ID":"cd073a44-83be-46ac-b226-c19cae15bda6","Type":"ContainerDied","Data":"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"}
Jul 25 01:05:37.774839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.774725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc" event={"ID":"cd073a44-83be-46ac-b226-c19cae15bda6","Type":"ContainerDied","Data":"70e07e419b0c5de60fee8783cbfcb7e3d2d20547e23c05849e5b7ef74dd1a250"}
Jul 25 01:05:37.774839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.774749    2574 scope.go:117] "RemoveContainer" containerID="544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"
Jul 25 01:05:37.783584 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.783564    2574 scope.go:117] "RemoveContainer" containerID="544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"
Jul 25 01:05:37.783855 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:05:37.783835    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5\": container with ID starting with 544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5 not found: ID does not exist" containerID="544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"
Jul 25 01:05:37.783917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.783865    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5"} err="failed to get container status \"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5\": rpc error: code = NotFound desc = could not find container \"544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5\": container with ID starting with 544feeab53e4deb312d987802408b6453e3b1544c88604339354c717d1404cd5 not found: ID does not exist"
Jul 25 01:05:37.795793 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.795751    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:05:37.798918 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:37.798889    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-b59a4a38-kserve-56f545bc6c-jnpmc"]
Jul 25 01:05:38.522502 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:05:38.522468    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd073a44-83be-46ac-b226-c19cae15bda6" path="/var/lib/kubelet/pods/cd073a44-83be-46ac-b226-c19cae15bda6/volumes"
Jul 25 01:09:10.709883 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.709802    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:10.710411 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.710169    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd073a44-83be-46ac-b226-c19cae15bda6" containerName="main"
Jul 25 01:09:10.710411 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.710181    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd073a44-83be-46ac-b226-c19cae15bda6" containerName="main"
Jul 25 01:09:10.710411 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.710235    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd073a44-83be-46ac-b226-c19cae15bda6" containerName="main"
Jul 25 01:09:10.713037 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.713017    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.715502 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.715483    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-82216ebf-serving-cert\""
Jul 25 01:09:10.724238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.724216    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:10.813103 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.813046    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pnw\" (UniqueName: \"kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.813290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.813173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.813290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.813244    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.914486 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.914448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.914844 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.914510    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.914844 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.914552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pnw\" (UniqueName: \"kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.914844 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:09:10.914667    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-serving-cert: secret "maas-api-e2e-ait-82216ebf-serving-cert" not found
Jul 25 01:09:10.914844 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:09:10.914732    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls podName:d1bc0bc7-558c-4b72-8196-6e70625ff32f nodeName:}" failed. No retries permitted until 2026-07-25 01:09:11.414712307 +0000 UTC m=+1991.462440299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls") pod "maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" (UID: "d1bc0bc7-558c-4b72-8196-6e70625ff32f") : secret "maas-api-e2e-ait-82216ebf-serving-cert" not found
Jul 25 01:09:10.915312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.915288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:10.925479 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:10.925454    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pnw\" (UniqueName: \"kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:11.308156 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.308118    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:11.311599 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.311577    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.314238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.314219    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-82216ebf\""
Jul 25 01:09:11.314363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.314346    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-82216ebf-dockercfg-bl6pg\""
Jul 25 01:09:11.320557 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.320534    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:11.420411 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.420372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.420602 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.420524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg8md\" (UniqueName: \"kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.420675 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.420627    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:11.423015 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.422996    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") pod \"maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:11.521737 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.521699    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.521887 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.521762    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg8md\" (UniqueName: \"kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.522544 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.522523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.530522 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.530500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg8md\" (UniqueName: \"kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md\") pod \"payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") " pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.623626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.623543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:11.623781 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.623660    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:11.765104 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.765042    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:11.766852 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:09:11.766814    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode970ab82_58be_4154_92a0_8e517b3e36e9.slice/crio-3f2b4bf559e73431004b260afebb4bb2e3303bb2034a2659232d1af94732ad81 WatchSource:0}: Error finding container 3f2b4bf559e73431004b260afebb4bb2e3303bb2034a2659232d1af94732ad81: Status 404 returned error can't find the container with id 3f2b4bf559e73431004b260afebb4bb2e3303bb2034a2659232d1af94732ad81
Jul 25 01:09:11.785707 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.785685    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:11.787167 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:09:11.787140    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bc0bc7_558c_4b72_8196_6e70625ff32f.slice/crio-b91858fb5c6c26aba60f95f03d3ef0e1a60e740789b45a0f865dda90e1c54160 WatchSource:0}: Error finding container b91858fb5c6c26aba60f95f03d3ef0e1a60e740789b45a0f865dda90e1c54160: Status 404 returned error can't find the container with id b91858fb5c6c26aba60f95f03d3ef0e1a60e740789b45a0f865dda90e1c54160
Jul 25 01:09:11.788567 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:11.788546    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:09:12.742185 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.742149    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" event={"ID":"e970ab82-58be-4154-92a0-8e517b3e36e9","Type":"ContainerStarted","Data":"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"}
Jul 25 01:09:12.742401 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.742208    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" event={"ID":"e970ab82-58be-4154-92a0-8e517b3e36e9","Type":"ContainerStarted","Data":"3f2b4bf559e73431004b260afebb4bb2e3303bb2034a2659232d1af94732ad81"}
Jul 25 01:09:12.742401 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.742239    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:12.743850 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.743815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" event={"ID":"d1bc0bc7-558c-4b72-8196-6e70625ff32f","Type":"ContainerStarted","Data":"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"}
Jul 25 01:09:12.743952 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.743863    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" event={"ID":"d1bc0bc7-558c-4b72-8196-6e70625ff32f","Type":"ContainerStarted","Data":"b91858fb5c6c26aba60f95f03d3ef0e1a60e740789b45a0f865dda90e1c54160"}
Jul 25 01:09:12.744023 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.744004    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:12.759370 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.759324    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" podStartSLOduration=1.759310693 podStartE2EDuration="1.759310693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:09:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:09:12.75832825 +0000 UTC m=+1992.806056245" watchObservedRunningTime="2026-07-25 01:09:12.759310693 +0000 UTC m=+1992.807038687"
Jul 25 01:09:12.776665 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:12.776616    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" podStartSLOduration=2.351535199 podStartE2EDuration="2.776600852s" totalImagesPullingTime="425.065653ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:09:12.775645419 +0000 UTC m=+1992.823373415" watchObservedRunningTime="2026-07-25 01:09:12.776600852 +0000 UTC m=+1992.824328846"
Jul 25 01:09:18.754244 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:18.754211    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:23.750941 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:23.750912    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:46.527240 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.527144    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:46.527861 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.527369    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" podUID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" containerName="maas-api" containerID="cri-o://cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd" gracePeriod=30
Jul 25 01:09:46.583170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.583136    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:46.583411 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.583386    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" podUID="e970ab82-58be-4154-92a0-8e517b3e36e9" containerName="payload-processing" containerID="cri-o://504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f" gracePeriod=30
Jul 25 01:09:46.830787 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.830758    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:46.853937 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.853910    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:46.896525 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.896490    2574 generic.go:356] "Generic (PLEG): container finished" podID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" containerID="cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd" exitCode=0
Jul 25 01:09:46.896719 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.896548    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"
Jul 25 01:09:46.896719 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.896567    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" event={"ID":"d1bc0bc7-558c-4b72-8196-6e70625ff32f","Type":"ContainerDied","Data":"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"}
Jul 25 01:09:46.896719 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.896617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl" event={"ID":"d1bc0bc7-558c-4b72-8196-6e70625ff32f","Type":"ContainerDied","Data":"b91858fb5c6c26aba60f95f03d3ef0e1a60e740789b45a0f865dda90e1c54160"}
Jul 25 01:09:46.896719 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.896638    2574 scope.go:117] "RemoveContainer" containerID="cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"
Jul 25 01:09:46.898108 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.898086    2574 generic.go:356] "Generic (PLEG): container finished" podID="e970ab82-58be-4154-92a0-8e517b3e36e9" containerID="504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f" exitCode=0
Jul 25 01:09:46.898248 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.898138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" event={"ID":"e970ab82-58be-4154-92a0-8e517b3e36e9","Type":"ContainerDied","Data":"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"}
Jul 25 01:09:46.898248 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.898174    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms" event={"ID":"e970ab82-58be-4154-92a0-8e517b3e36e9","Type":"ContainerDied","Data":"3f2b4bf559e73431004b260afebb4bb2e3303bb2034a2659232d1af94732ad81"}
Jul 25 01:09:46.898248 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.898194    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"
Jul 25 01:09:46.905049 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.905029    2574 scope.go:117] "RemoveContainer" containerID="cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"
Jul 25 01:09:46.905391 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:09:46.905375    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd\": container with ID starting with cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd not found: ID does not exist" containerID="cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"
Jul 25 01:09:46.905460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.905400    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd"} err="failed to get container status \"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd\": rpc error: code = NotFound desc = could not find container \"cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd\": container with ID starting with cd943e5c0e628e8c62112ae0f80c8840dedb59b243623db6fd7f1e134b5882cd not found: ID does not exist"
Jul 25 01:09:46.905460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.905415    2574 scope.go:117] "RemoveContainer" containerID="504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"
Jul 25 01:09:46.912828 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.912814    2574 scope.go:117] "RemoveContainer" containerID="504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"
Jul 25 01:09:46.913037 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:09:46.913023    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f\": container with ID starting with 504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f not found: ID does not exist" containerID="504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"
Jul 25 01:09:46.913147 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.913042    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f"} err="failed to get container status \"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f\": rpc error: code = NotFound desc = could not find container \"504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f\": container with ID starting with 504d074647b40649892eb69dc1415eafab78fdd8fa4642e116407c6c378cdb2f not found: ID does not exist"
Jul 25 01:09:46.941405 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.941380    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca\") pod \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") "
Jul 25 01:09:46.941537 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.941419    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2pnw\" (UniqueName: \"kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw\") pod \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") "
Jul 25 01:09:46.941537 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.941467    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") pod \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\" (UID: \"d1bc0bc7-558c-4b72-8196-6e70625ff32f\") "
Jul 25 01:09:46.941742 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.941712    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d1bc0bc7-558c-4b72-8196-6e70625ff32f" (UID: "d1bc0bc7-558c-4b72-8196-6e70625ff32f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:09:46.943614 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.943585    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d1bc0bc7-558c-4b72-8196-6e70625ff32f" (UID: "d1bc0bc7-558c-4b72-8196-6e70625ff32f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:09:46.943614 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:46.943600    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw" (OuterVolumeSpecName: "kube-api-access-x2pnw") pod "d1bc0bc7-558c-4b72-8196-6e70625ff32f" (UID: "d1bc0bc7-558c-4b72-8196-6e70625ff32f"). InnerVolumeSpecName "kube-api-access-x2pnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:09:47.042316 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042276    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume\") pod \"e970ab82-58be-4154-92a0-8e517b3e36e9\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") "
Jul 25 01:09:47.042496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042394    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg8md\" (UniqueName: \"kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md\") pod \"e970ab82-58be-4154-92a0-8e517b3e36e9\" (UID: \"e970ab82-58be-4154-92a0-8e517b3e36e9\") "
Jul 25 01:09:47.042592 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042571    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1bc0bc7-558c-4b72-8196-6e70625ff32f-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:09:47.042592 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042587    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2pnw\" (UniqueName: \"kubernetes.io/projected/d1bc0bc7-558c-4b72-8196-6e70625ff32f-kube-api-access-x2pnw\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:09:47.042701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042596    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1bc0bc7-558c-4b72-8196-6e70625ff32f-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:09:47.042701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.042658    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e970ab82-58be-4154-92a0-8e517b3e36e9" (UID: "e970ab82-58be-4154-92a0-8e517b3e36e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:09:47.044575 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.044552    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md" (OuterVolumeSpecName: "kube-api-access-cg8md") pod "e970ab82-58be-4154-92a0-8e517b3e36e9" (UID: "e970ab82-58be-4154-92a0-8e517b3e36e9"). InnerVolumeSpecName "kube-api-access-cg8md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:09:47.143932 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.143850    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg8md\" (UniqueName: \"kubernetes.io/projected/e970ab82-58be-4154-92a0-8e517b3e36e9-kube-api-access-cg8md\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:09:47.143932 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.143879    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e970ab82-58be-4154-92a0-8e517b3e36e9-plugins-config-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:09:47.220557 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.220523    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:47.224407 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.224380    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-82216ebf-7994b986f8-jhtzl"]
Jul 25 01:09:47.234556 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.234534    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:47.238020 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:47.237997    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-82216ebf-655f8cd54d-kpdms"]
Jul 25 01:09:48.522018 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:48.521984    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" path="/var/lib/kubelet/pods/d1bc0bc7-558c-4b72-8196-6e70625ff32f/volumes"
Jul 25 01:09:48.522446 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:48.522430    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e970ab82-58be-4154-92a0-8e517b3e36e9" path="/var/lib/kubelet/pods/e970ab82-58be-4154-92a0-8e517b3e36e9/volumes"
Jul 25 01:09:52.481528 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481493    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:09:52.481909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481842    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e970ab82-58be-4154-92a0-8e517b3e36e9" containerName="payload-processing"
Jul 25 01:09:52.481909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481854    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e970ab82-58be-4154-92a0-8e517b3e36e9" containerName="payload-processing"
Jul 25 01:09:52.481909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481866    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" containerName="maas-api"
Jul 25 01:09:52.481909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481872    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" containerName="maas-api"
Jul 25 01:09:52.482037 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481924    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e970ab82-58be-4154-92a0-8e517b3e36e9" containerName="payload-processing"
Jul 25 01:09:52.482037 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.481934    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1bc0bc7-558c-4b72-8196-6e70625ff32f" containerName="maas-api"
Jul 25 01:09:52.486294 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.486273    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.489104 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.489088    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0b6fd8e2-gw-openshift-default-dockercfg-jppxt\""
Jul 25 01:09:52.499882 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.499863    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:09:52.585915 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.585880    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586101 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.585927    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586101 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.585946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586101 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586066    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586212 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586212 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586118    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6dmt\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586212 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586212 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586160    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.586338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.586206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687406 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687371    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687419    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687436    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687482    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687500    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687522    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6dmt\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687548    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687583 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687572    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687954 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687817    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687954 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.687954 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.687913    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.688115 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.688096    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.688226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.688205    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.688269 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.688235    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.690310 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.690288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.690629 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.690606    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.698750 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.698731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.699348 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.699328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6dmt\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt\") pod \"e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") " pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.795803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.795737    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:52.948690 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.948656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:09:52.951844 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:09:52.951815    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c595184_0715_41e7_b3d7_f3ea88999d9a.slice/crio-4f540927e94d01dd9b2f88a8e500ef183e732efa54bb045e46a586a0deb3d8b1 WatchSource:0}: Error finding container 4f540927e94d01dd9b2f88a8e500ef183e732efa54bb045e46a586a0deb3d8b1: Status 404 returned error can't find the container with id 4f540927e94d01dd9b2f88a8e500ef183e732efa54bb045e46a586a0deb3d8b1
Jul 25 01:09:52.953958 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.953929    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:09:52.954017 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.953996    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:09:52.954050 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:52.954024    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:09:53.932594 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:53.932559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerStarted","Data":"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"}
Jul 25 01:09:53.933079 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:53.932617    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerStarted","Data":"4f540927e94d01dd9b2f88a8e500ef183e732efa54bb045e46a586a0deb3d8b1"}
Jul 25 01:09:53.954253 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:53.954207    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podStartSLOduration=1.9541915090000002 podStartE2EDuration="1.954191509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:09:53.951983151 +0000 UTC m=+2033.999711158" watchObservedRunningTime="2026-07-25 01:09:53.954191509 +0000 UTC m=+2034.001919548"
Jul 25 01:09:54.796550 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:54.796515    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:54.801386 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:54.801358    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:54.937641 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:54.937609    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:54.938612 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:54.938594    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:09:56.523023 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.522992    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:09:56.526348 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.526332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.529036 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.529012    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-0b6fd8e2-dockercfg-b4f6m\""
Jul 25 01:09:56.529192 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.529012    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-0b6fd8e2\""
Jul 25 01:09:56.536682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.536659    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:09:56.630288 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.630252    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.630483 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.630337    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp87j\" (UniqueName: \"kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.731705 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.731670    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp87j\" (UniqueName: \"kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.731876 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.731749    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.732433 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.732415    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.739320 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.739290    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp87j\" (UniqueName: \"kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j\") pod \"payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.838129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.838044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:56.969198 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:56.969157    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:09:56.971547 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:09:56.971520    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332144fb_f10a_4476_bd0f_2d29d0514d3a.slice/crio-ee3d42194a35737948e03d68595a8f2e87f4f143047eccd8f0dc6336c75d60f7 WatchSource:0}: Error finding container ee3d42194a35737948e03d68595a8f2e87f4f143047eccd8f0dc6336c75d60f7: Status 404 returned error can't find the container with id ee3d42194a35737948e03d68595a8f2e87f4f143047eccd8f0dc6336c75d60f7
Jul 25 01:09:57.956943 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:57.956903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" event={"ID":"332144fb-f10a-4476-bd0f-2d29d0514d3a","Type":"ContainerStarted","Data":"b056dd72c9b6e951c4c092700f50cec19790498c5255524acdb92bc6ecc3bed5"}
Jul 25 01:09:57.957376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:57.956969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" event={"ID":"332144fb-f10a-4476-bd0f-2d29d0514d3a","Type":"ContainerStarted","Data":"ee3d42194a35737948e03d68595a8f2e87f4f143047eccd8f0dc6336c75d60f7"}
Jul 25 01:09:57.957376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:57.956998    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:09:57.974452 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:09:57.974386    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" podStartSLOduration=1.974370329 podStartE2EDuration="1.974370329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:09:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:09:57.974078871 +0000 UTC m=+2038.021806856" watchObservedRunningTime="2026-07-25 01:09:57.974370329 +0000 UTC m=+2038.022098325"
Jul 25 01:10:08.965307 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:08.965266    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:10:09.939317 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:09.939227    2574 patch_prober.go:28] interesting pod/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 25 01:10:09.939317 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:09.939297    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 25 01:10:10.013669 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.013638    2574 generic.go:356] "Generic (PLEG): container finished" podID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerID="287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a" exitCode=0
Jul 25 01:10:10.014095 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.013696    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerDied","Data":"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"}
Jul 25 01:10:10.014151 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.014142    2574 scope.go:117] "RemoveContainer" containerID="287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"
Jul 25 01:10:10.015110 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.015084    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:10:10.015217 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.015151    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:10:10.015217 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:10.015186    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:10:11.020206 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:11.020170    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerStarted","Data":"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"}
Jul 25 01:10:11.796372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:11.796337    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:11.796568 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:11.796549    2574 patch_prober.go:28] interesting pod/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 25 01:10:11.796625 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:11.796605    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 25 01:10:12.796771 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:12.796725    2574 patch_prober.go:28] interesting pod/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 25 01:10:12.797456 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:12.796791    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 25 01:10:13.796277 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:13.796242    2574 patch_prober.go:28] interesting pod/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 25 01:10:13.796482 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:13.796308    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 25 01:10:14.796189 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:14.796155    2574 patch_prober.go:28] interesting pod/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 25 01:10:14.796578 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:14.796225    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 25 01:10:15.800901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:15.800873    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:15.801336 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:15.801248    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:15.801894 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:15.801877    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:30.944704 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:30.944322    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:10:30.945833 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:30.944812    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" podUID="332144fb-f10a-4476-bd0f-2d29d0514d3a" containerName="payload-pre-processing" containerID="cri-o://b056dd72c9b6e951c4c092700f50cec19790498c5255524acdb92bc6ecc3bed5" gracePeriod=30
Jul 25 01:10:31.113640 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.113601    2574 generic.go:356] "Generic (PLEG): container finished" podID="332144fb-f10a-4476-bd0f-2d29d0514d3a" containerID="b056dd72c9b6e951c4c092700f50cec19790498c5255524acdb92bc6ecc3bed5" exitCode=0
Jul 25 01:10:31.113901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.113673    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" event={"ID":"332144fb-f10a-4476-bd0f-2d29d0514d3a","Type":"ContainerDied","Data":"b056dd72c9b6e951c4c092700f50cec19790498c5255524acdb92bc6ecc3bed5"}
Jul 25 01:10:31.197312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.197251    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:10:31.257915 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.257873    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume\") pod \"332144fb-f10a-4476-bd0f-2d29d0514d3a\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") "
Jul 25 01:10:31.258125 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.257977    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp87j\" (UniqueName: \"kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j\") pod \"332144fb-f10a-4476-bd0f-2d29d0514d3a\" (UID: \"332144fb-f10a-4476-bd0f-2d29d0514d3a\") "
Jul 25 01:10:31.258262 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.258237    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "332144fb-f10a-4476-bd0f-2d29d0514d3a" (UID: "332144fb-f10a-4476-bd0f-2d29d0514d3a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:10:31.260020 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.259997    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j" (OuterVolumeSpecName: "kube-api-access-xp87j") pod "332144fb-f10a-4476-bd0f-2d29d0514d3a" (UID: "332144fb-f10a-4476-bd0f-2d29d0514d3a"). InnerVolumeSpecName "kube-api-access-xp87j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:10:31.358927 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.358887    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp87j\" (UniqueName: \"kubernetes.io/projected/332144fb-f10a-4476-bd0f-2d29d0514d3a-kube-api-access-xp87j\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:31.358927 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:31.358920    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/332144fb-f10a-4476-bd0f-2d29d0514d3a-plugins-config-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:32.119934 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.119903    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"
Jul 25 01:10:32.119934 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.119925    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q" event={"ID":"332144fb-f10a-4476-bd0f-2d29d0514d3a","Type":"ContainerDied","Data":"ee3d42194a35737948e03d68595a8f2e87f4f143047eccd8f0dc6336c75d60f7"}
Jul 25 01:10:32.120480 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.119989    2574 scope.go:117] "RemoveContainer" containerID="b056dd72c9b6e951c4c092700f50cec19790498c5255524acdb92bc6ecc3bed5"
Jul 25 01:10:32.141349 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.141321    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:10:32.144949 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.144925    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0b6fd8e2-6fc46c98d8-tld7q"]
Jul 25 01:10:32.521879 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:32.521834    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="332144fb-f10a-4476-bd0f-2d29d0514d3a" path="/var/lib/kubelet/pods/332144fb-f10a-4476-bd0f-2d29d0514d3a/volumes"
Jul 25 01:10:35.665760 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:35.665727    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:10:35.666256 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:35.665973    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy" containerID="cri-o://23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915" gracePeriod=30
Jul 25 01:10:39.970944 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.970906    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:10:39.971363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.971286    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332144fb-f10a-4476-bd0f-2d29d0514d3a" containerName="payload-pre-processing"
Jul 25 01:10:39.971363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.971298    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="332144fb-f10a-4476-bd0f-2d29d0514d3a" containerName="payload-pre-processing"
Jul 25 01:10:39.971363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.971350    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="332144fb-f10a-4476-bd0f-2d29d0514d3a" containerName="payload-pre-processing"
Jul 25 01:10:39.974915 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.974892    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:39.977672 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.977650    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0f061979\""
Jul 25 01:10:39.977766 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.977701    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0f061979-dockercfg-f6kqx\""
Jul 25 01:10:39.984351 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:39.984330    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:10:40.005014 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.004981    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:10:40.007524 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.007507    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.016475 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.016444    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:10:40.038263 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.038226    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvz5\" (UniqueName: \"kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.038420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.038282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.038420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.038313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swll\" (UniqueName: \"kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.038420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.038354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.139024 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.138992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.139246 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.139038    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6swll\" (UniqueName: \"kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.139246 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.139107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.139246 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.139140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvz5\" (UniqueName: \"kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.140005 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.139979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.140094 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.139979    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.147143 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.147120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swll\" (UniqueName: \"kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll\") pod \"payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.147323 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.147301    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvz5\" (UniqueName: \"kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5\") pod \"payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") " pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.286053 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.285966    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:40.318342 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.318310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:40.435297 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.435272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:10:40.437482 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:10:40.437453    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a27a55_c0d0_4477_aa98_50989f57c0d6.slice/crio-9b468e217aa11a35667c848bce50184fcd0d8cb37012e06c97f5d903901bdcd1 WatchSource:0}: Error finding container 9b468e217aa11a35667c848bce50184fcd0d8cb37012e06c97f5d903901bdcd1: Status 404 returned error can't find the container with id 9b468e217aa11a35667c848bce50184fcd0d8cb37012e06c97f5d903901bdcd1
Jul 25 01:10:40.465564 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.465479    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:10:40.468130 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:10:40.468101    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95f0897_1665_4b5e_8b59_5399383e45b8.slice/crio-616e1a44e76d66a7d2257ceb444a736d9ceb0bffacecc1e2448b27b486836a4e WatchSource:0}: Error finding container 616e1a44e76d66a7d2257ceb444a736d9ceb0bffacecc1e2448b27b486836a4e: Status 404 returned error can't find the container with id 616e1a44e76d66a7d2257ceb444a736d9ceb0bffacecc1e2448b27b486836a4e
Jul 25 01:10:40.896481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.896455    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:40.946795 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946719    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.946795 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946787    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.946990 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946824    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.946990 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946859    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.946990 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946888    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.947163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.946992    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.947163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947021    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6dmt\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.947163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947045    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.947163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947094    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket\") pod \"9c595184-0715-41e7-b3d7-f3ea88999d9a\" (UID: \"9c595184-0715-41e7-b3d7-f3ea88999d9a\") "
Jul 25 01:10:40.947401 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947343    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:10:40.947762 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947573    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:10:40.947762 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.947718    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:10:40.948024 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.948004    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:10:40.948142 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.948096    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:10:40.949587 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.949561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:10:40.949843 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.949816    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:10:40.950032 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.950011    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:10:40.950032 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:40.950007    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt" (OuterVolumeSpecName: "kube-api-access-c6dmt") pod "9c595184-0715-41e7-b3d7-f3ea88999d9a" (UID: "9c595184-0715-41e7-b3d7-f3ea88999d9a"). InnerVolumeSpecName "kube-api-access-c6dmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:10:41.048381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048348    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048377    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6dmt\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-kube-api-access-c6dmt\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048388    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048396    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048404    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048412    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048420    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c595184-0715-41e7-b3d7-f3ea88999d9a-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048427    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.048825 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.048437    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c595184-0715-41e7-b3d7-f3ea88999d9a-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:10:41.165092 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.165043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" event={"ID":"b95f0897-1665-4b5e-8b59-5399383e45b8","Type":"ContainerStarted","Data":"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"}
Jul 25 01:10:41.165338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.165311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" event={"ID":"b95f0897-1665-4b5e-8b59-5399383e45b8","Type":"ContainerStarted","Data":"616e1a44e76d66a7d2257ceb444a736d9ceb0bffacecc1e2448b27b486836a4e"}
Jul 25 01:10:41.165487 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.165354    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:10:41.166888 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.166861    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" event={"ID":"93a27a55-c0d0-4477-aa98-50989f57c0d6","Type":"ContainerStarted","Data":"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"}
Jul 25 01:10:41.167002 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.166914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" event={"ID":"93a27a55-c0d0-4477-aa98-50989f57c0d6","Type":"ContainerStarted","Data":"9b468e217aa11a35667c848bce50184fcd0d8cb37012e06c97f5d903901bdcd1"}
Jul 25 01:10:41.167002 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.166986    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:41.168470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.168449    2574 generic.go:356] "Generic (PLEG): container finished" podID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerID="23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915" exitCode=0
Jul 25 01:10:41.168553 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.168511    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"
Jul 25 01:10:41.168553 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.168526    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerDied","Data":"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"}
Jul 25 01:10:41.168678 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.168583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp" event={"ID":"9c595184-0715-41e7-b3d7-f3ea88999d9a","Type":"ContainerDied","Data":"4f540927e94d01dd9b2f88a8e500ef183e732efa54bb045e46a586a0deb3d8b1"}
Jul 25 01:10:41.168678 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.168617    2574 scope.go:117] "RemoveContainer" containerID="23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"
Jul 25 01:10:41.177508 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.177493    2574 scope.go:117] "RemoveContainer" containerID="287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"
Jul 25 01:10:41.183165 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.183127    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" podStartSLOduration=2.183113683 podStartE2EDuration="2.183113683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:10:41.182320067 +0000 UTC m=+2081.230048063" watchObservedRunningTime="2026-07-25 01:10:41.183113683 +0000 UTC m=+2081.230841677"
Jul 25 01:10:41.185955 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.185938    2574 scope.go:117] "RemoveContainer" containerID="23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"
Jul 25 01:10:41.186237 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:10:41.186218    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915\": container with ID starting with 23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915 not found: ID does not exist" containerID="23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"
Jul 25 01:10:41.186290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.186246    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915"} err="failed to get container status \"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915\": rpc error: code = NotFound desc = could not find container \"23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915\": container with ID starting with 23472632cc776afd56f3537da0352f4ff1931204754c8c534d57fa6db17bc915 not found: ID does not exist"
Jul 25 01:10:41.186290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.186262    2574 scope.go:117] "RemoveContainer" containerID="287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"
Jul 25 01:10:41.186556 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:10:41.186534    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a\": container with ID starting with 287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a not found: ID does not exist" containerID="287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"
Jul 25 01:10:41.186609 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.186564    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a"} err="failed to get container status \"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a\": rpc error: code = NotFound desc = could not find container \"287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a\": container with ID starting with 287b7482bc375cf6aafbfb5035816ee231eeba8e1a23da3765e7e72335e6ae6a not found: ID does not exist"
Jul 25 01:10:41.196317 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.196294    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:10:41.199529 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.199466    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0b6fd8e2-gw-openshift-default-65594f956d-gllrp"]
Jul 25 01:10:41.213291 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:41.213251    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" podStartSLOduration=2.213238784 podStartE2EDuration="2.213238784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:10:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:10:41.211975338 +0000 UTC m=+2081.259703335" watchObservedRunningTime="2026-07-25 01:10:41.213238784 +0000 UTC m=+2081.260966800"
Jul 25 01:10:42.521769 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:42.521735    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" path="/var/lib/kubelet/pods/9c595184-0715-41e7-b3d7-f3ea88999d9a/volumes"
Jul 25 01:10:52.175973 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:52.175937    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:10:52.176431 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:10:52.176105    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:11:15.427758 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.427721    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:11:15.428385 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.427968    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" podUID="b95f0897-1665-4b5e-8b59-5399383e45b8" containerName="payload-processing" containerID="cri-o://7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e" gracePeriod=30
Jul 25 01:11:15.437157 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.437119    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:11:15.437913 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.437428    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" podUID="93a27a55-c0d0-4477-aa98-50989f57c0d6" containerName="payload-pre-processing" containerID="cri-o://62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b" gracePeriod=30
Jul 25 01:11:15.685412 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.685359    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:11:15.712839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.712811    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:11:15.751731 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.751700    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6swll\" (UniqueName: \"kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll\") pod \"93a27a55-c0d0-4477-aa98-50989f57c0d6\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") "
Jul 25 01:11:15.751873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.751761    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljvz5\" (UniqueName: \"kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5\") pod \"b95f0897-1665-4b5e-8b59-5399383e45b8\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") "
Jul 25 01:11:15.751873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.751826    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume\") pod \"b95f0897-1665-4b5e-8b59-5399383e45b8\" (UID: \"b95f0897-1665-4b5e-8b59-5399383e45b8\") "
Jul 25 01:11:15.751965 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.751871    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume\") pod \"93a27a55-c0d0-4477-aa98-50989f57c0d6\" (UID: \"93a27a55-c0d0-4477-aa98-50989f57c0d6\") "
Jul 25 01:11:15.752257 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.752228    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b95f0897-1665-4b5e-8b59-5399383e45b8" (UID: "b95f0897-1665-4b5e-8b59-5399383e45b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:11:15.752389 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.752303    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93a27a55-c0d0-4477-aa98-50989f57c0d6" (UID: "93a27a55-c0d0-4477-aa98-50989f57c0d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:11:15.753755 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.753731    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll" (OuterVolumeSpecName: "kube-api-access-6swll") pod "93a27a55-c0d0-4477-aa98-50989f57c0d6" (UID: "93a27a55-c0d0-4477-aa98-50989f57c0d6"). InnerVolumeSpecName "kube-api-access-6swll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:11:15.753898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.753877    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5" (OuterVolumeSpecName: "kube-api-access-ljvz5") pod "b95f0897-1665-4b5e-8b59-5399383e45b8" (UID: "b95f0897-1665-4b5e-8b59-5399383e45b8"). InnerVolumeSpecName "kube-api-access-ljvz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:11:15.853431 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.853402    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljvz5\" (UniqueName: \"kubernetes.io/projected/b95f0897-1665-4b5e-8b59-5399383e45b8-kube-api-access-ljvz5\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:11:15.853431 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.853427    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b95f0897-1665-4b5e-8b59-5399383e45b8-plugins-config-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:11:15.853431 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.853437    2574 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93a27a55-c0d0-4477-aa98-50989f57c0d6-plugins-config-volume\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:11:15.853643 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:15.853448    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6swll\" (UniqueName: \"kubernetes.io/projected/93a27a55-c0d0-4477-aa98-50989f57c0d6-kube-api-access-6swll\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:11:16.326712 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.326674    2574 generic.go:356] "Generic (PLEG): container finished" podID="b95f0897-1665-4b5e-8b59-5399383e45b8" containerID="7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e" exitCode=0
Jul 25 01:11:16.326898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.326720    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"
Jul 25 01:11:16.326898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.326763    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" event={"ID":"b95f0897-1665-4b5e-8b59-5399383e45b8","Type":"ContainerDied","Data":"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"}
Jul 25 01:11:16.326898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.326819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2" event={"ID":"b95f0897-1665-4b5e-8b59-5399383e45b8","Type":"ContainerDied","Data":"616e1a44e76d66a7d2257ceb444a736d9ceb0bffacecc1e2448b27b486836a4e"}
Jul 25 01:11:16.326898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.326854    2574 scope.go:117] "RemoveContainer" containerID="7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"
Jul 25 01:11:16.328077 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.327973    2574 generic.go:356] "Generic (PLEG): container finished" podID="93a27a55-c0d0-4477-aa98-50989f57c0d6" containerID="62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b" exitCode=0
Jul 25 01:11:16.328077 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.328033    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"
Jul 25 01:11:16.328184 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.328049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" event={"ID":"93a27a55-c0d0-4477-aa98-50989f57c0d6","Type":"ContainerDied","Data":"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"}
Jul 25 01:11:16.328184 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.328115    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv" event={"ID":"93a27a55-c0d0-4477-aa98-50989f57c0d6","Type":"ContainerDied","Data":"9b468e217aa11a35667c848bce50184fcd0d8cb37012e06c97f5d903901bdcd1"}
Jul 25 01:11:16.335594 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.335526    2574 scope.go:117] "RemoveContainer" containerID="7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"
Jul 25 01:11:16.335817 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:11:16.335798    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e\": container with ID starting with 7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e not found: ID does not exist" containerID="7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"
Jul 25 01:11:16.335868 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.335824    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e"} err="failed to get container status \"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e\": rpc error: code = NotFound desc = could not find container \"7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e\": container with ID starting with 7664f5ab3406b9a0ffb76dd94b1d246e946efee8fa0764dce9e0b26cad0e229e not found: ID does not exist"
Jul 25 01:11:16.335868 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.335840    2574 scope.go:117] "RemoveContainer" containerID="62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"
Jul 25 01:11:16.343946 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.343930    2574 scope.go:117] "RemoveContainer" containerID="62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"
Jul 25 01:11:16.344244 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:11:16.344226    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b\": container with ID starting with 62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b not found: ID does not exist" containerID="62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"
Jul 25 01:11:16.344314 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.344252    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b"} err="failed to get container status \"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b\": rpc error: code = NotFound desc = could not find container \"62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b\": container with ID starting with 62e15666fdf2bde1972345228d1411ffb371896ec2749c2115ec83bd2810207b not found: ID does not exist"
Jul 25 01:11:16.352533 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.352509    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:11:16.358842 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.358821    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0f061979-598d7bcbfb-s2nqv"]
Jul 25 01:11:16.369261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.369230    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:11:16.371289 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.371270    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0f061979-9755f4b48-7dcs2"]
Jul 25 01:11:16.521733 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.521701    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a27a55-c0d0-4477-aa98-50989f57c0d6" path="/var/lib/kubelet/pods/93a27a55-c0d0-4477-aa98-50989f57c0d6/volumes"
Jul 25 01:11:16.522116 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:16.522091    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95f0897-1665-4b5e-8b59-5399383e45b8" path="/var/lib/kubelet/pods/b95f0897-1665-4b5e-8b59-5399383e45b8/volumes"
Jul 25 01:11:22.057030 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.056998    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057383    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a27a55-c0d0-4477-aa98-50989f57c0d6" containerName="payload-pre-processing"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057395    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a27a55-c0d0-4477-aa98-50989f57c0d6" containerName="payload-pre-processing"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057409    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057415    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057421    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95f0897-1665-4b5e-8b59-5399383e45b8" containerName="payload-processing"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057427    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95f0897-1665-4b5e-8b59-5399383e45b8" containerName="payload-processing"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057435    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057440    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057492    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057501    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a27a55-c0d0-4477-aa98-50989f57c0d6" containerName="payload-pre-processing"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057508    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c595184-0715-41e7-b3d7-f3ea88999d9a" containerName="istio-proxy"
Jul 25 01:11:22.057626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.057515    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95f0897-1665-4b5e-8b59-5399383e45b8" containerName="payload-processing"
Jul 25 01:11:22.061969 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.061950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.064581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.064562    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a271f0bb-openshift-default-dockercfg-hsqhz\""
Jul 25 01:11:22.072682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.072661    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:11:22.106130 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106102    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106245 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106169    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106245 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106245 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106245 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106236    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106279    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l644n\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106381 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.106645 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.106381    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207052 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207020    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207152    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207182    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207207    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207231    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l644n\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207532 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207276    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207532 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207304    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207532 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207345    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207532 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207743 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207635    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207743 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.207813 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.207760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.208233 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.208210    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.209671 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.209649    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.209994 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.209965    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.219379 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.219354    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l644n\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.219565 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.219548    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token\") pod \"e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") " pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.373075 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.372971    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:22.509830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.509796    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:11:22.511721 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:11:22.511698    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1558261f_8e89_4a9d_afe0_4e8cd1eb3555.slice/crio-a1b0785893febc978b5a14a2b95f2d09aecda4ec3954e8237fd7507f059ec3d5 WatchSource:0}: Error finding container a1b0785893febc978b5a14a2b95f2d09aecda4ec3954e8237fd7507f059ec3d5: Status 404 returned error can't find the container with id a1b0785893febc978b5a14a2b95f2d09aecda4ec3954e8237fd7507f059ec3d5
Jul 25 01:11:22.513724 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.513691    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:22.513821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.513770    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:22.513821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:22.513811    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:23.362384 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:23.362350    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerStarted","Data":"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"}
Jul 25 01:11:23.362816 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:23.362401    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerStarted","Data":"a1b0785893febc978b5a14a2b95f2d09aecda4ec3954e8237fd7507f059ec3d5"}
Jul 25 01:11:23.374121 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:23.374088    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:23.378902 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:23.378879    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:23.384106 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:23.384050    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" podStartSLOduration=1.384037347 podStartE2EDuration="1.384037347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:11:23.381945457 +0000 UTC m=+2123.429673453" watchObservedRunningTime="2026-07-25 01:11:23.384037347 +0000 UTC m=+2123.431765341"
Jul 25 01:11:24.367163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:24.367132    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:24.368389 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:24.368366    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:38.435165 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.435039    2574 generic.go:356] "Generic (PLEG): container finished" podID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerID="3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326" exitCode=0
Jul 25 01:11:38.435165 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.435117    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerDied","Data":"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"}
Jul 25 01:11:38.435691 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.435551    2574 scope.go:117] "RemoveContainer" containerID="3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"
Jul 25 01:11:38.436568 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.436540    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:38.436624 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.436608    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:38.436668 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:38.436644    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:11:39.367902 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:39.367852    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:39.441765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:39.441731    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerStarted","Data":"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"}
Jul 25 01:11:40.373408 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:40.373364    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:40.374626 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:40.374599    2574 patch_prober.go:28] interesting pod/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 25 01:11:40.374737 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:40.374662    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 25 01:11:41.373990 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:41.373950    2574 patch_prober.go:28] interesting pod/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 25 01:11:41.374418 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:41.374022    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 25 01:11:42.374314 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:42.374273    2574 patch_prober.go:28] interesting pod/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Jul 25 01:11:42.374744 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:42.374345    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Jul 25 01:11:43.376638 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:43.376608    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:43.377052 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:43.376878    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:11:43.377460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:11:43.377441    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:12:04.866226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:04.866183    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:12:04.866725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:04.866484    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy" containerID="cri-o://7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0" gracePeriod=30
Jul 25 01:12:10.115343 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.115317    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:12:10.145797 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145725    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145797 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145771    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145828    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145852    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145914    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145956    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.145983 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.145957    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:12:10.146283 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146000    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.146283 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146052    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.146283 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146115    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l644n\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n\") pod \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\" (UID: \"1558261f-8e89-4a9d-afe0-4e8cd1eb3555\") "
Jul 25 01:12:10.146283 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146236    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:12:10.146283 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146248    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:12:10.146597 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146448    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:12:10.146652 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146618    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.146652 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146635    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.146652 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146648    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.146812 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.146661    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.147186 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.147163    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data" (OuterVolumeSpecName: "istio-data") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:12:10.148240 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.148214    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:12:10.148520 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.148494    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token" (OuterVolumeSpecName: "istio-token") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:12:10.148592 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.148520    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n" (OuterVolumeSpecName: "kube-api-access-l644n") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "kube-api-access-l644n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:12:10.148682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.148658    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1558261f-8e89-4a9d-afe0-4e8cd1eb3555" (UID: "1558261f-8e89-4a9d-afe0-4e8cd1eb3555"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:12:10.247766 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.247728    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.247766 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.247759    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l644n\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-kube-api-access-l644n\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.247974 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.247774    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.247974 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.247788    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.247974 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.247799    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1558261f-8e89-4a9d-afe0-4e8cd1eb3555-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:12:10.594274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.594238    2574 generic.go:356] "Generic (PLEG): container finished" podID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerID="7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0" exitCode=0
Jul 25 01:12:10.594446 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.594299    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"
Jul 25 01:12:10.594446 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.594320    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerDied","Data":"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"}
Jul 25 01:12:10.594446 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.594378    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw" event={"ID":"1558261f-8e89-4a9d-afe0-4e8cd1eb3555","Type":"ContainerDied","Data":"a1b0785893febc978b5a14a2b95f2d09aecda4ec3954e8237fd7507f059ec3d5"}
Jul 25 01:12:10.594446 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.594399    2574 scope.go:117] "RemoveContainer" containerID="7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"
Jul 25 01:12:10.602805 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.602785    2574 scope.go:117] "RemoveContainer" containerID="3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"
Jul 25 01:12:10.610648 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.610623    2574 scope.go:117] "RemoveContainer" containerID="7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"
Jul 25 01:12:10.611099 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:12:10.611033    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0\": container with ID starting with 7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0 not found: ID does not exist" containerID="7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"
Jul 25 01:12:10.611217 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.611094    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0"} err="failed to get container status \"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0\": rpc error: code = NotFound desc = could not find container \"7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0\": container with ID starting with 7009aaa173af678fd10bb19d96084baa079c40193c7d876ea26d3d48efc7abb0 not found: ID does not exist"
Jul 25 01:12:10.611217 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.611119    2574 scope.go:117] "RemoveContainer" containerID="3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"
Jul 25 01:12:10.611452 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:12:10.611425    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326\": container with ID starting with 3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326 not found: ID does not exist" containerID="3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"
Jul 25 01:12:10.611559 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.611458    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326"} err="failed to get container status \"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326\": rpc error: code = NotFound desc = could not find container \"3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326\": container with ID starting with 3fd319ad6d592754b7dd10969af97a653b7daf56a10ed130aa61c2cff99b4326 not found: ID does not exist"
Jul 25 01:12:10.612734 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.612714    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:12:10.616151 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:10.616129    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a271f0bb-openshift-default-6b5cb899bd-fjjkw"]
Jul 25 01:12:12.521339 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:12:12.521308    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" path="/var/lib/kubelet/pods/1558261f-8e89-4a9d-afe0-4e8cd1eb3555/volumes"
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:44.999227    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.000432    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.000454    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.000492    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.000511    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:13:45.004152 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.002702    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:13:45.008582 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.008549    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.011617 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.011588    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-818dfc55-serving-cert\""
Jul 25 01:13:45.013021 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.012991    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:13:45.092823 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.092788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j92m4\" (UniqueName: \"kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.093006 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.092868    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.093006 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.092905    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.194213 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.194177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.194420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.194242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j92m4\" (UniqueName: \"kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.194420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.194293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.194912 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.194887    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.196774 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.196752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.202776 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.202752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j92m4\" (UniqueName: \"kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4\") pod \"maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.321385 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.321278    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:45.478337 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:45.478312    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:13:45.479965 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:13:45.479936    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eaa9ee8_9352_4f34_bd87_a021250b4cc6.slice/crio-ed4fb717d1a7c4aaa7ac154dcb28d5872b20a6ad0ee4561727be57c4da47d4d0 WatchSource:0}: Error finding container ed4fb717d1a7c4aaa7ac154dcb28d5872b20a6ad0ee4561727be57c4da47d4d0: Status 404 returned error can't find the container with id ed4fb717d1a7c4aaa7ac154dcb28d5872b20a6ad0ee4561727be57c4da47d4d0
Jul 25 01:13:46.012934 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:46.012894    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" event={"ID":"5eaa9ee8-9352-4f34-bd87-a021250b4cc6","Type":"ContainerStarted","Data":"fbf41f0680e37442816f828cfa11c3edf94c4facd5163eedc3667b09b2ecba27"}
Jul 25 01:13:46.013340 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:46.012948    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" event={"ID":"5eaa9ee8-9352-4f34-bd87-a021250b4cc6","Type":"ContainerStarted","Data":"ed4fb717d1a7c4aaa7ac154dcb28d5872b20a6ad0ee4561727be57c4da47d4d0"}
Jul 25 01:13:46.013340 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:46.013020    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:13:46.029308 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:46.029258    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" podStartSLOduration=1.625549521 podStartE2EDuration="2.029245656s" totalImagesPullingTime="403.696135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:13:46.028895612 +0000 UTC m=+2266.076623608" watchObservedRunningTime="2026-07-25 01:13:46.029245656 +0000 UTC m=+2266.076973651"
Jul 25 01:13:52.025321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:13:52.025291    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:14:06.922864 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:06.922827    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:14:06.923354 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:06.923081    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerName="maas-api" containerID="cri-o://fbf41f0680e37442816f828cfa11c3edf94c4facd5163eedc3667b09b2ecba27" gracePeriod=30
Jul 25 01:14:07.019002 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.018847    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.43:8443/health\": dial tcp 10.133.0.43:8443: connect: connection refused"
Jul 25 01:14:07.109840 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.109809    2574 generic.go:356] "Generic (PLEG): container finished" podID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerID="fbf41f0680e37442816f828cfa11c3edf94c4facd5163eedc3667b09b2ecba27" exitCode=0
Jul 25 01:14:07.109982 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.109883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" event={"ID":"5eaa9ee8-9352-4f34-bd87-a021250b4cc6","Type":"ContainerDied","Data":"fbf41f0680e37442816f828cfa11c3edf94c4facd5163eedc3667b09b2ecba27"}
Jul 25 01:14:07.172836 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.172814    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:14:07.296147 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.296113    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca\") pod \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") "
Jul 25 01:14:07.296344 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.296178    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j92m4\" (UniqueName: \"kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4\") pod \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") "
Jul 25 01:14:07.296344 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.296216    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls\") pod \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\" (UID: \"5eaa9ee8-9352-4f34-bd87-a021250b4cc6\") "
Jul 25 01:14:07.296553 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.296527    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5eaa9ee8-9352-4f34-bd87-a021250b4cc6" (UID: "5eaa9ee8-9352-4f34-bd87-a021250b4cc6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:14:07.298298 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.298265    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5eaa9ee8-9352-4f34-bd87-a021250b4cc6" (UID: "5eaa9ee8-9352-4f34-bd87-a021250b4cc6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:14:07.298405 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.298324    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4" (OuterVolumeSpecName: "kube-api-access-j92m4") pod "5eaa9ee8-9352-4f34-bd87-a021250b4cc6" (UID: "5eaa9ee8-9352-4f34-bd87-a021250b4cc6"). InnerVolumeSpecName "kube-api-access-j92m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:14:07.397174 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.397137    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j92m4\" (UniqueName: \"kubernetes.io/projected/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-kube-api-access-j92m4\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:14:07.397174 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.397168    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:14:07.397174 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:07.397178    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5eaa9ee8-9352-4f34-bd87-a021250b4cc6-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:14:08.115828 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.115798    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"
Jul 25 01:14:08.115828 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.115806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4" event={"ID":"5eaa9ee8-9352-4f34-bd87-a021250b4cc6","Type":"ContainerDied","Data":"ed4fb717d1a7c4aaa7ac154dcb28d5872b20a6ad0ee4561727be57c4da47d4d0"}
Jul 25 01:14:08.116334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.115871    2574 scope.go:117] "RemoveContainer" containerID="fbf41f0680e37442816f828cfa11c3edf94c4facd5163eedc3667b09b2ecba27"
Jul 25 01:14:08.136991 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.136966    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:14:08.142756 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.142734    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-818dfc55-f5cf7fc49-5cmw4"]
Jul 25 01:14:08.528462 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:08.528426    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" path="/var/lib/kubelet/pods/5eaa9ee8-9352-4f34-bd87-a021250b4cc6/volumes"
Jul 25 01:14:41.412515 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.412478    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:14:41.412995 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.412868    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerName="maas-api"
Jul 25 01:14:41.412995 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.412881    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerName="maas-api"
Jul 25 01:14:41.412995 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.412949    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5eaa9ee8-9352-4f34-bd87-a021250b4cc6" containerName="maas-api"
Jul 25 01:14:41.412995 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.412958    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1558261f-8e89-4a9d-afe0-4e8cd1eb3555" containerName="istio-proxy"
Jul 25 01:14:41.415674 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.415657    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.418271 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.418247    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-98d19c4d-serving-cert\""
Jul 25 01:14:41.428341 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.428317    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:14:41.488493 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.488465    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.488653 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.488499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.488653 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.488526    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4gm2\" (UniqueName: \"kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.589372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.589340    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.589372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.589374    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.589627 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.589400    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4gm2\" (UniqueName: \"kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.589627 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:14:41.589510    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-serving-cert: secret "maas-api-e2e-mt-98d19c4d-serving-cert" not found
Jul 25 01:14:41.589627 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:14:41.589585    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls podName:20a08ace-e864-479b-9eab-8d71d2f3178a nodeName:}" failed. No retries permitted until 2026-07-25 01:14:42.089565259 +0000 UTC m=+2322.137293239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls") pod "maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" (UID: "20a08ace-e864-479b-9eab-8d71d2f3178a") : secret "maas-api-e2e-mt-98d19c4d-serving-cert" not found
Jul 25 01:14:41.589960 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.589939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:41.598621 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:41.598595    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4gm2\" (UniqueName: \"kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:42.095837 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:42.095803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:42.098481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:42.098447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") pod \"maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:42.326110 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:42.326048    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:42.459937 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:42.459912    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:14:42.461983 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:14:42.461957    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a08ace_e864_479b_9eab_8d71d2f3178a.slice/crio-ad0aafffd7d159edee4bb2cf7b85c94a8d4a9743a0894bc5523aff399623473a WatchSource:0}: Error finding container ad0aafffd7d159edee4bb2cf7b85c94a8d4a9743a0894bc5523aff399623473a: Status 404 returned error can't find the container with id ad0aafffd7d159edee4bb2cf7b85c94a8d4a9743a0894bc5523aff399623473a
Jul 25 01:14:42.463234 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:42.463215    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:14:43.276159 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:43.276125    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" event={"ID":"20a08ace-e864-479b-9eab-8d71d2f3178a","Type":"ContainerStarted","Data":"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"}
Jul 25 01:14:43.276338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:43.276204    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" event={"ID":"20a08ace-e864-479b-9eab-8d71d2f3178a","Type":"ContainerStarted","Data":"ad0aafffd7d159edee4bb2cf7b85c94a8d4a9743a0894bc5523aff399623473a"}
Jul 25 01:14:43.276338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:43.276249    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:14:43.295803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:43.295750    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" podStartSLOduration=1.829128999 podStartE2EDuration="2.295734731s" totalImagesPullingTime="466.605732ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:14:43.294289977 +0000 UTC m=+2323.342017972" watchObservedRunningTime="2026-07-25 01:14:43.295734731 +0000 UTC m=+2323.343462726"
Jul 25 01:14:49.286185 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:14:49.286154    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:15:07.896705 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.896665    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:15:07.900542 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.900514    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:07.903470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.903444    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-98d19c4d\"/\"kube-root-ca.crt\""
Jul 25 01:15:07.903594 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.903483    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-98d19c4d\"/\"openshift-service-ca.crt\""
Jul 25 01:15:07.905183 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.905163    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-98d19c4d\"/\"e2e-lifecycle-model-98d19c4d-kserve-self-signed-certs\""
Jul 25 01:15:07.905451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.905183    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-98d19c4d\"/\"default-dockercfg-7vgkr\""
Jul 25 01:15:07.908265 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:07.907817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:15:08.035356 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.035356 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.035581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035392    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.035581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035475    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.035581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.035581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.035568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwz9\" (UniqueName: \"kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.136789 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.136789 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136790    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137046 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwz9\" (UniqueName: \"kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137046 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136872    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137046 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137046 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.136925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137278 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.137259    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.137271    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.137485 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.137468    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.139218 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.139193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.139391 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.139373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.146925 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.146861    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwz9\" (UniqueName: \"kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9\") pod \"e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") " pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.211274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.211229    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:08.345196 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.345167    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:15:08.347393 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:15:08.347365    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff8f62b_c0ac_43cb_8dc0_d809e38b05a2.slice/crio-4ac61e3946afc8f6adabea7bcc90dd40a0d820651c82c5ed9e382ad6be4b3c8b WatchSource:0}: Error finding container 4ac61e3946afc8f6adabea7bcc90dd40a0d820651c82c5ed9e382ad6be4b3c8b: Status 404 returned error can't find the container with id 4ac61e3946afc8f6adabea7bcc90dd40a0d820651c82c5ed9e382ad6be4b3c8b
Jul 25 01:15:08.390830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:08.390805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" event={"ID":"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2","Type":"ContainerStarted","Data":"4ac61e3946afc8f6adabea7bcc90dd40a0d820651c82c5ed9e382ad6be4b3c8b"}
Jul 25 01:15:09.396108 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:09.396071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" event={"ID":"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2","Type":"ContainerStarted","Data":"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"}
Jul 25 01:15:09.415527 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:09.415476    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" podStartSLOduration=2.4154612650000002 podStartE2EDuration="2.415461265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:15:09.414268334 +0000 UTC m=+2349.461996328" watchObservedRunningTime="2026-07-25 01:15:09.415461265 +0000 UTC m=+2349.463189259"
Jul 25 01:15:18.211531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:18.211476    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:18.211531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:18.211546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:18.224178 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:18.224154    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:18.448519 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:18.448490    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:15:51.183027 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.182988    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:15:51.183611 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.183324    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" podUID="20a08ace-e864-479b-9eab-8d71d2f3178a" containerName="maas-api" containerID="cri-o://c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69" gracePeriod=30
Jul 25 01:15:51.431563 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.431531    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:15:51.533470 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.533440    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") pod \"20a08ace-e864-479b-9eab-8d71d2f3178a\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") "
Jul 25 01:15:51.533656 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.533476    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca\") pod \"20a08ace-e864-479b-9eab-8d71d2f3178a\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") "
Jul 25 01:15:51.533656 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.533521    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4gm2\" (UniqueName: \"kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2\") pod \"20a08ace-e864-479b-9eab-8d71d2f3178a\" (UID: \"20a08ace-e864-479b-9eab-8d71d2f3178a\") "
Jul 25 01:15:51.533906 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.533878    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20a08ace-e864-479b-9eab-8d71d2f3178a" (UID: "20a08ace-e864-479b-9eab-8d71d2f3178a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:15:51.535573 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.535549    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20a08ace-e864-479b-9eab-8d71d2f3178a" (UID: "20a08ace-e864-479b-9eab-8d71d2f3178a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:15:51.535650 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.535615    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2" (OuterVolumeSpecName: "kube-api-access-q4gm2") pod "20a08ace-e864-479b-9eab-8d71d2f3178a" (UID: "20a08ace-e864-479b-9eab-8d71d2f3178a"). InnerVolumeSpecName "kube-api-access-q4gm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:15:51.585023 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.584990    2574 generic.go:356] "Generic (PLEG): container finished" podID="20a08ace-e864-479b-9eab-8d71d2f3178a" containerID="c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69" exitCode=0
Jul 25 01:15:51.585179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.585036    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" event={"ID":"20a08ace-e864-479b-9eab-8d71d2f3178a","Type":"ContainerDied","Data":"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"}
Jul 25 01:15:51.585179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.585052    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"
Jul 25 01:15:51.585179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.585110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577" event={"ID":"20a08ace-e864-479b-9eab-8d71d2f3178a","Type":"ContainerDied","Data":"ad0aafffd7d159edee4bb2cf7b85c94a8d4a9743a0894bc5523aff399623473a"}
Jul 25 01:15:51.585179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.585136    2574 scope.go:117] "RemoveContainer" containerID="c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"
Jul 25 01:15:51.593748 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.593729    2574 scope.go:117] "RemoveContainer" containerID="c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"
Jul 25 01:15:51.593989 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:15:51.593971    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69\": container with ID starting with c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69 not found: ID does not exist" containerID="c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"
Jul 25 01:15:51.594033 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.593997    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69"} err="failed to get container status \"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69\": rpc error: code = NotFound desc = could not find container \"c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69\": container with ID starting with c671f9b891dfb2fedefdd63fc7e73209aaa0d8d88d048125e68424dab27c0c69 not found: ID does not exist"
Jul 25 01:15:51.606867 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.606836    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:15:51.608701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.608682    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-98d19c4d-578f8d6cc7-mx577"]
Jul 25 01:15:51.635103 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.635080    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20a08ace-e864-479b-9eab-8d71d2f3178a-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:15:51.635103 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.635101    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20a08ace-e864-479b-9eab-8d71d2f3178a-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:15:51.635207 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:51.635111    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4gm2\" (UniqueName: \"kubernetes.io/projected/20a08ace-e864-479b-9eab-8d71d2f3178a-kube-api-access-q4gm2\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:15:52.522420 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:15:52.522389    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20a08ace-e864-479b-9eab-8d71d2f3178a" path="/var/lib/kubelet/pods/20a08ace-e864-479b-9eab-8d71d2f3178a/volumes"
Jul 25 01:16:04.152386 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:04.152342    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:16:19.171529 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.171490    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" podUID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" containerName="main" containerID="cri-o://21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e" gracePeriod=45
Jul 25 01:16:19.418832 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.418809    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:16:19.481535 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481507    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481548    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481579    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zwz9\" (UniqueName: \"kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481614    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481686    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481932 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481737    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs\") pod \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\" (UID: \"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2\") "
Jul 25 01:16:19.481932 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481807    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home" (OuterVolumeSpecName: "home") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:16:19.482045 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481975    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:16:19.482045 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.481995    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:16:19.482179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.482120    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.483762 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.483741    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm" (OuterVolumeSpecName: "dshm") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:16:19.484161 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.484128    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9" (OuterVolumeSpecName: "kube-api-access-4zwz9") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "kube-api-access-4zwz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:16:19.484289 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.484175    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" (UID: "1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:16:19.583201 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.583166    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.583201 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.583192    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.583201 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.583202    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.583201 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.583210    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.583492 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.583219    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zwz9\" (UniqueName: \"kubernetes.io/projected/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2-kube-api-access-4zwz9\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:16:19.708757 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.708721    2574 generic.go:356] "Generic (PLEG): container finished" podID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" containerID="21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e" exitCode=0
Jul 25 01:16:19.708926 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.708764    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"
Jul 25 01:16:19.708926 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.708796    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" event={"ID":"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2","Type":"ContainerDied","Data":"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"}
Jul 25 01:16:19.708926 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.708834    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x" event={"ID":"1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2","Type":"ContainerDied","Data":"4ac61e3946afc8f6adabea7bcc90dd40a0d820651c82c5ed9e382ad6be4b3c8b"}
Jul 25 01:16:19.708926 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.708855    2574 scope.go:117] "RemoveContainer" containerID="21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"
Jul 25 01:16:19.717654 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.717627    2574 scope.go:117] "RemoveContainer" containerID="21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"
Jul 25 01:16:19.717932 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:16:19.717909    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e\": container with ID starting with 21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e not found: ID does not exist" containerID="21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"
Jul 25 01:16:19.718023 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.717941    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e"} err="failed to get container status \"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e\": rpc error: code = NotFound desc = could not find container \"21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e\": container with ID starting with 21e353a5d37a6fd40e4c4f4f3494ca46c350575f93798ffad14646b70c4f503e not found: ID does not exist"
Jul 25 01:16:19.730138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.730113    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:16:19.733385 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:19.733333    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-98d19c4d/e2e-lifecycle-model-98d19c4d-kserve-74bd9ff955-kzn7x"]
Jul 25 01:16:20.521428 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:16:20.521398    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" path="/var/lib/kubelet/pods/1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2/volumes"
Jul 25 01:17:45.590699 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.590666    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591042    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20a08ace-e864-479b-9eab-8d71d2f3178a" containerName="maas-api"
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591082    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="20a08ace-e864-479b-9eab-8d71d2f3178a" containerName="maas-api"
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591110    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" containerName="main"
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591117    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" containerName="main"
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591176    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="20a08ace-e864-479b-9eab-8d71d2f3178a" containerName="maas-api"
Jul 25 01:17:45.591334 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.591187    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ff8f62b-c0ac-43cb-8dc0-d809e38b05a2" containerName="main"
Jul 25 01:17:45.594215 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.594196    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.597086 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.597043    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d08be1-serving-cert\""
Jul 25 01:17:45.605291 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.605265    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:17:45.659839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.659805    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ggsd\" (UniqueName: \"kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.660029 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.659850    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.660029 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.659886    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.761229 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.761189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ggsd\" (UniqueName: \"kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.761412 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.761242    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.761412 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.761291    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.761412 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:17:45.761406    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-serving-cert: secret "maas-api-e2e-inf-a-d08be1-serving-cert" not found
Jul 25 01:17:45.761519 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:17:45.761474    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls podName:b102d78d-dd0e-41c7-bdae-865ca961886e nodeName:}" failed. No retries permitted until 2026-07-25 01:17:46.261459075 +0000 UTC m=+2506.309187048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls") pod "maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" (UID: "b102d78d-dd0e-41c7-bdae-865ca961886e") : secret "maas-api-e2e-inf-a-d08be1-serving-cert" not found
Jul 25 01:17:45.761925 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.761901    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:45.772535 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:45.772506    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ggsd\" (UniqueName: \"kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:46.266556 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:46.266519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:46.268883 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:46.268860    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") pod \"maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:46.507430 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:46.507392    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:46.641716 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:46.641683    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:17:46.644781 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:17:46.644754    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb102d78d_dd0e_41c7_bdae_865ca961886e.slice/crio-44040f4af163a79e9bbf4eaee753d782bb2174f36727f20e2e075ed2bc7c998d WatchSource:0}: Error finding container 44040f4af163a79e9bbf4eaee753d782bb2174f36727f20e2e075ed2bc7c998d: Status 404 returned error can't find the container with id 44040f4af163a79e9bbf4eaee753d782bb2174f36727f20e2e075ed2bc7c998d
Jul 25 01:17:47.099836 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:47.099800    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" event={"ID":"b102d78d-dd0e-41c7-bdae-865ca961886e","Type":"ContainerStarted","Data":"44040f4af163a79e9bbf4eaee753d782bb2174f36727f20e2e075ed2bc7c998d"}
Jul 25 01:17:48.106121 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:48.106083    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" event={"ID":"b102d78d-dd0e-41c7-bdae-865ca961886e","Type":"ContainerStarted","Data":"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"}
Jul 25 01:17:48.106619 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:48.106206    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:48.123483 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:48.123440    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" podStartSLOduration=2.618480103 podStartE2EDuration="3.123425475s" totalImagesPullingTime="504.945372ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:48.122469476 +0000 UTC m=+2508.170197472" watchObservedRunningTime="2026-07-25 01:17:48.123425475 +0000 UTC m=+2508.171153470"
Jul 25 01:17:50.679015 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.678978    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:17:50.682620 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.682599    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.685169 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.685148    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9deb1f-openshift-default-dockercfg-9dj4g\""
Jul 25 01:17:50.693712 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.693689    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:17:50.801918 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.801883    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.801918 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.801921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802175 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802002    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v422q\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802175 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802175 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802175 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802175 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802356 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.802356 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.802212    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903298 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903266    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v422q\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903471 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903324    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903471 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903390    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903471 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903432    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903635 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903472    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903635 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903635 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903527    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903635 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903635 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903776    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.903898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903823    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.904017 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.904017 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.903977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.904261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.904240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.905706 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.905686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.906096 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.906076    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.916911 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.916883    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.917013 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.916995    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v422q\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q\") pod \"e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") " pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:50.993071 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:50.993029    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:51.130710 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:51.130680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:17:51.132783 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:17:51.132762    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308d1ab4_39ce_4dad_b0b2_cb7dc97997c1.slice/crio-f97512195bde914a5476425b5723ba2d9b57ec5b8e4ab67258e3152abecd4ad8 WatchSource:0}: Error finding container f97512195bde914a5476425b5723ba2d9b57ec5b8e4ab67258e3152abecd4ad8: Status 404 returned error can't find the container with id f97512195bde914a5476425b5723ba2d9b57ec5b8e4ab67258e3152abecd4ad8
Jul 25 01:17:51.134839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:51.134809    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:51.134901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:51.134875    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:51.134940 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:51.134901    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:17:52.125949 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:52.125833    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerStarted","Data":"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"}
Jul 25 01:17:52.125949 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:52.125888    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerStarted","Data":"f97512195bde914a5476425b5723ba2d9b57ec5b8e4ab67258e3152abecd4ad8"}
Jul 25 01:17:52.146358 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:52.146300    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podStartSLOduration=2.1462808 podStartE2EDuration="2.1462808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:52.145896434 +0000 UTC m=+2512.193624431" watchObservedRunningTime="2026-07-25 01:17:52.1462808 +0000 UTC m=+2512.194008799"
Jul 25 01:17:52.993864 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:52.993823    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:52.998561 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:52.998540    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:53.130714 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:53.130686    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:53.131556 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:53.131531    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:17:54.115715 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.115690    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:17:54.181050 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.181015    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:17:54.184780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.184750    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.187371 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.187349    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-9deb1f-serving-cert\""
Jul 25 01:17:54.194405 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.194377    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:17:54.334491 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.334453    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.334668 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.334501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qvwx\" (UniqueName: \"kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.334668 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.334534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.435305 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.435206    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.435305 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.435263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qvwx\" (UniqueName: \"kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.435305 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.435289    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.435601 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:17:54.435418    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-serving-cert: secret "maas-api-e2e-inf-b-9deb1f-serving-cert" not found
Jul 25 01:17:54.435601 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:17:54.435472    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls podName:57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa nodeName:}" failed. No retries permitted until 2026-07-25 01:17:54.935455082 +0000 UTC m=+2514.983183054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls") pod "maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" (UID: "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa") : secret "maas-api-e2e-inf-b-9deb1f-serving-cert" not found
Jul 25 01:17:54.435910 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.435889    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.446427 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.446391    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qvwx\" (UniqueName: \"kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.940082 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.940031    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:54.942551 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:54.942523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") pod \"maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:55.096674 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:55.096633    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:55.227256 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:55.227225    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:17:55.229358 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:17:55.229327    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d2ff5d_9e9e_4f23_b03b_d6e38c6a08fa.slice/crio-bb6bcf239adcc2d81577105f64e369cdd78ad14fd6aa400c09d79295812174be WatchSource:0}: Error finding container bb6bcf239adcc2d81577105f64e369cdd78ad14fd6aa400c09d79295812174be: Status 404 returned error can't find the container with id bb6bcf239adcc2d81577105f64e369cdd78ad14fd6aa400c09d79295812174be
Jul 25 01:17:56.154314 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:56.154270    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" event={"ID":"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa","Type":"ContainerStarted","Data":"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"}
Jul 25 01:17:56.154544 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:56.154341    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:17:56.154544 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:56.154363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" event={"ID":"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa","Type":"ContainerStarted","Data":"bb6bcf239adcc2d81577105f64e369cdd78ad14fd6aa400c09d79295812174be"}
Jul 25 01:17:56.198705 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:17:56.198650    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" podStartSLOduration=1.847221411 podStartE2EDuration="2.198634308s" totalImagesPullingTime="351.412897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:17:56.197686689 +0000 UTC m=+2516.245414685" watchObservedRunningTime="2026-07-25 01:17:56.198634308 +0000 UTC m=+2516.246362294"
Jul 25 01:18:02.168201 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:02.168168    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:18:08.132803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.132767    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:18:08.133172 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.132853    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 25 01:18:08.213313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.213280    2574 generic.go:356] "Generic (PLEG): container finished" podID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerID="d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b" exitCode=0
Jul 25 01:18:08.213488 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.213356    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerDied","Data":"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"}
Jul 25 01:18:08.213768 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.213752    2574 scope.go:117] "RemoveContainer" containerID="d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"
Jul 25 01:18:08.214814 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.214785    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:18:08.214877 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.214862    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:18:08.214916 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:08.214901    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:18:09.219650 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:09.219620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerStarted","Data":"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"}
Jul 25 01:18:09.993687 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:09.993650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:18:09.993934 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:09.993907    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:18:09.993990 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:09.993960    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 25 01:18:10.994133 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:10.994094    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:18:10.994551 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:10.994157    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 25 01:18:11.993756 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:11.993717    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:18:11.993945 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:11.993775    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 25 01:18:12.994377 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:12.994339    2574 patch_prober.go:28] interesting pod/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 25 01:18:12.994786 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:12.994401    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 25 01:18:13.997016 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:13.996989    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:18:13.997436 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:13.997347    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:18:13.997996 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:18:13.997976    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:19:30.092765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.092679    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:19:30.093288 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.092931    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" podUID="b102d78d-dd0e-41c7-bdae-865ca961886e" containerName="maas-api" containerID="cri-o://d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8" gracePeriod=30
Jul 25 01:19:30.349791 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.349735    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:19:30.518709 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.518681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") pod \"b102d78d-dd0e-41c7-bdae-865ca961886e\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") "
Jul 25 01:19:30.518901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.518794    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ggsd\" (UniqueName: \"kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd\") pod \"b102d78d-dd0e-41c7-bdae-865ca961886e\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") "
Jul 25 01:19:30.518901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.518841    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca\") pod \"b102d78d-dd0e-41c7-bdae-865ca961886e\" (UID: \"b102d78d-dd0e-41c7-bdae-865ca961886e\") "
Jul 25 01:19:30.519241 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.519206    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b102d78d-dd0e-41c7-bdae-865ca961886e" (UID: "b102d78d-dd0e-41c7-bdae-865ca961886e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:19:30.521270 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.521245    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b102d78d-dd0e-41c7-bdae-865ca961886e" (UID: "b102d78d-dd0e-41c7-bdae-865ca961886e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:19:30.521405 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.521310    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd" (OuterVolumeSpecName: "kube-api-access-5ggsd") pod "b102d78d-dd0e-41c7-bdae-865ca961886e" (UID: "b102d78d-dd0e-41c7-bdae-865ca961886e"). InnerVolumeSpecName "kube-api-access-5ggsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:19:30.585165 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.585127    2574 generic.go:356] "Generic (PLEG): container finished" podID="b102d78d-dd0e-41c7-bdae-865ca961886e" containerID="d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8" exitCode=0
Jul 25 01:19:30.585318 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.585179    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"
Jul 25 01:19:30.585318 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.585206    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" event={"ID":"b102d78d-dd0e-41c7-bdae-865ca961886e","Type":"ContainerDied","Data":"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"}
Jul 25 01:19:30.585318 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.585262    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7" event={"ID":"b102d78d-dd0e-41c7-bdae-865ca961886e","Type":"ContainerDied","Data":"44040f4af163a79e9bbf4eaee753d782bb2174f36727f20e2e075ed2bc7c998d"}
Jul 25 01:19:30.585318 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.585285    2574 scope.go:117] "RemoveContainer" containerID="d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"
Jul 25 01:19:30.594075 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.594038    2574 scope.go:117] "RemoveContainer" containerID="d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"
Jul 25 01:19:30.594394 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:19:30.594375    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8\": container with ID starting with d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8 not found: ID does not exist" containerID="d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"
Jul 25 01:19:30.594476 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.594415    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8"} err="failed to get container status \"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8\": rpc error: code = NotFound desc = could not find container \"d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8\": container with ID starting with d7dc972b35d17fee73682836ed80adca3230ec259288e7a903035082f1a830f8 not found: ID does not exist"
Jul 25 01:19:30.601768 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.601704    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:19:30.604265 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.604245    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d08be1-786ddf65df-r9fp7"]
Jul 25 01:19:30.620448 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.620427    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b102d78d-dd0e-41c7-bdae-865ca961886e-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:30.620448 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.620448    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b102d78d-dd0e-41c7-bdae-865ca961886e-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:30.620572 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:30.620459    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ggsd\" (UniqueName: \"kubernetes.io/projected/b102d78d-dd0e-41c7-bdae-865ca961886e-kube-api-access-5ggsd\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:32.521280 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:32.521241    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b102d78d-dd0e-41c7-bdae-865ca961886e" path="/var/lib/kubelet/pods/b102d78d-dd0e-41c7-bdae-865ca961886e/volumes"
Jul 25 01:19:52.009159 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.009124    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:19:52.009952 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.009895    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerName="maas-api" containerID="cri-o://8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27" gracePeriod=30
Jul 25 01:19:52.160753 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.160700    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.48:8443/health\": dial tcp 10.133.0.48:8443: connect: connection refused"
Jul 25 01:19:52.254392 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.254368    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:19:52.322372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.322339    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca\") pod \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") "
Jul 25 01:19:52.322372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.322374    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qvwx\" (UniqueName: \"kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx\") pod \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") "
Jul 25 01:19:52.322578 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.322422    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") pod \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\" (UID: \"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa\") "
Jul 25 01:19:52.322756 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.322726    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" (UID: "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:19:52.324549 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.324519    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx" (OuterVolumeSpecName: "kube-api-access-9qvwx") pod "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" (UID: "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa"). InnerVolumeSpecName "kube-api-access-9qvwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:19:52.324549 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.324525    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" (UID: "57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:19:52.423216 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.423133    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:52.423216 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.423163    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qvwx\" (UniqueName: \"kubernetes.io/projected/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-kube-api-access-9qvwx\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:52.423216 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.423174    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:19:52.686031 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.685927    2574 generic.go:356] "Generic (PLEG): container finished" podID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerID="8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27" exitCode=0
Jul 25 01:19:52.686031 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.685977    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"
Jul 25 01:19:52.686031 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.685996    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" event={"ID":"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa","Type":"ContainerDied","Data":"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"}
Jul 25 01:19:52.686343 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.686049    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd" event={"ID":"57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa","Type":"ContainerDied","Data":"bb6bcf239adcc2d81577105f64e369cdd78ad14fd6aa400c09d79295812174be"}
Jul 25 01:19:52.686343 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.686096    2574 scope.go:117] "RemoveContainer" containerID="8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"
Jul 25 01:19:52.694915 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.694896    2574 scope.go:117] "RemoveContainer" containerID="8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"
Jul 25 01:19:52.695238 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:19:52.695215    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27\": container with ID starting with 8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27 not found: ID does not exist" containerID="8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"
Jul 25 01:19:52.695302 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.695245    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27"} err="failed to get container status \"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27\": rpc error: code = NotFound desc = could not find container \"8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27\": container with ID starting with 8f01c91e938481bdda4ef48142524d2d02b0cbc9066c8fa20aafbe07fd9edc27 not found: ID does not exist"
Jul 25 01:19:52.705618 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.705595    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:19:52.711851 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:52.711828    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-9deb1f-7bc9bc7b95-zbshd"]
Jul 25 01:19:54.522120 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:19:54.522089    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" path="/var/lib/kubelet/pods/57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa/volumes"
Jul 25 01:20:03.031813 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:03.031779    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:20:03.032399 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:03.032048    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy" containerID="cri-o://530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a" gracePeriod=30
Jul 25 01:20:08.283451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.283425    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:20:08.372372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372283    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372372 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372333    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372378    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372406    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372437    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v422q\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372470    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372500    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372540    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372606 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372604    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket\") pod \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\" (UID: \"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1\") "
Jul 25 01:20:08.372978 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.372889    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:20:08.373118 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.373096    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:20:08.373208 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.373194    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:20:08.373269 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.373256    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:20:08.373331 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.373313    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:20:08.374646 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.374623    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:20:08.374755 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.374704    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q" (OuterVolumeSpecName: "kube-api-access-v422q") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "kube-api-access-v422q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:20:08.374881 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.374864    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:20:08.375131 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.374977    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" (UID: "308d1ab4-39ce-4dad-b0b2-cb7dc97997c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:20:08.473587 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473550    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473587 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473580    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473587 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473590    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473599    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473608    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473615    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473625    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v422q\" (UniqueName: \"kubernetes.io/projected/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-kube-api-access-v422q\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473633    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.473830 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.473641    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:20:08.762618 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.762586    2574 generic.go:356] "Generic (PLEG): container finished" podID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerID="530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a" exitCode=0
Jul 25 01:20:08.762796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.762639    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"
Jul 25 01:20:08.762796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.762666    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerDied","Data":"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"}
Jul 25 01:20:08.762796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.762720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r" event={"ID":"308d1ab4-39ce-4dad-b0b2-cb7dc97997c1","Type":"ContainerDied","Data":"f97512195bde914a5476425b5723ba2d9b57ec5b8e4ab67258e3152abecd4ad8"}
Jul 25 01:20:08.762796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.762742    2574 scope.go:117] "RemoveContainer" containerID="530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"
Jul 25 01:20:08.771800 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.771783    2574 scope.go:117] "RemoveContainer" containerID="d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"
Jul 25 01:20:08.779223 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.779207    2574 scope.go:117] "RemoveContainer" containerID="530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"
Jul 25 01:20:08.779464 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:20:08.779442    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a\": container with ID starting with 530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a not found: ID does not exist" containerID="530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"
Jul 25 01:20:08.779531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.779473    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a"} err="failed to get container status \"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a\": rpc error: code = NotFound desc = could not find container \"530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a\": container with ID starting with 530c84538f14e89931dd2ab54a239457373424717e9d674acf3aa802d0594b9a not found: ID does not exist"
Jul 25 01:20:08.779531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.779490    2574 scope.go:117] "RemoveContainer" containerID="d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"
Jul 25 01:20:08.779736 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:20:08.779716    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b\": container with ID starting with d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b not found: ID does not exist" containerID="d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"
Jul 25 01:20:08.779813 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.779742    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b"} err="failed to get container status \"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b\": rpc error: code = NotFound desc = could not find container \"d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b\": container with ID starting with d49cd3df7c95fca1ab6e3b4b8bcd9c9d4401ae3aabe25ff33d41414d52a1b20b not found: ID does not exist"
Jul 25 01:20:08.786581 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.786558    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:20:08.790729 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:08.790706    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9deb1f-openshift-default-85786d998b-pjb7r"]
Jul 25 01:20:10.522384 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:10.522350    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" path="/var/lib/kubelet/pods/308d1ab4-39ce-4dad-b0b2-cb7dc97997c1/volumes"
Jul 25 01:20:11.765482 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765449    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765786    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerName="maas-api"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765797    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerName="maas-api"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765817    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765822    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765830    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765836    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765845    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b102d78d-dd0e-41c7-bdae-865ca961886e" containerName="maas-api"
Jul 25 01:20:11.765858 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765850    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b102d78d-dd0e-41c7-bdae-865ca961886e" containerName="maas-api"
Jul 25 01:20:11.766137 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765902    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b102d78d-dd0e-41c7-bdae-865ca961886e" containerName="maas-api"
Jul 25 01:20:11.766137 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765909    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d2ff5d-9e9e-4f23-b03b-d6e38c6a08fa" containerName="maas-api"
Jul 25 01:20:11.766137 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765916    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.766137 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.765923    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="308d1ab4-39ce-4dad-b0b2-cb7dc97997c1" containerName="istio-proxy"
Jul 25 01:20:11.770162 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.770144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.773647 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.773627    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-015d51-openshift-default-dockercfg-sx6sd\""
Jul 25 01:20:11.793168 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.793147    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:20:11.905457 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905421    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905617 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905617 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905484    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905617 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905807 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905807 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905807 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905942 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhmvg\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:11.905942 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:11.905882    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006757 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006724    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006766    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006814    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006844    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhmvg\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.006917 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006914    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007200 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006957    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007200 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.006982    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007200 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007029    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007322 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007236    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007541 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007490    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007541 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007509    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007729 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007597    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.007790 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.007772    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.009359 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.009335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.009622 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.009607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.015613 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.015545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.015857 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.015835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhmvg\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg\") pod \"e2e-api-b-015d51-openshift-default-567587d498-8c2wr\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") " pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.080882 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.080839    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:12.215394 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.215368    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:20:12.217339 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:20:12.217312    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66f3aea_ec54_41a6_8253_87c6791f353b.slice/crio-d3be8cc6e61b079530996d2eb04f3a9fbccb475572a4e6cf156ba6754e7c5898 WatchSource:0}: Error finding container d3be8cc6e61b079530996d2eb04f3a9fbccb475572a4e6cf156ba6754e7c5898: Status 404 returned error can't find the container with id d3be8cc6e61b079530996d2eb04f3a9fbccb475572a4e6cf156ba6754e7c5898
Jul 25 01:20:12.219398 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.219366    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:12.219471 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.219433    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:12.219515 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.219468    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:12.783186 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.783147    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerStarted","Data":"d2e279009cc48a4b54ea301410af02cea07dcb02dcd3b23b705afeac466c1368"}
Jul 25 01:20:12.783650 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.783201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerStarted","Data":"d3be8cc6e61b079530996d2eb04f3a9fbccb475572a4e6cf156ba6754e7c5898"}
Jul 25 01:20:12.808463 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:12.808414    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podStartSLOduration=1.808397529 podStartE2EDuration="1.808397529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:20:12.806891498 +0000 UTC m=+2652.854619504" watchObservedRunningTime="2026-07-25 01:20:12.808397529 +0000 UTC m=+2652.856125524"
Jul 25 01:20:13.081101 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:13.080994    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:13.085979 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:13.085952    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:13.788292 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:13.788261    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:13.789477 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:13.789455    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:14.859575 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.859542    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:20:14.862956 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.862934    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:14.866319 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.866297    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-015d51-serving-cert\""
Jul 25 01:20:14.877683 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.877658    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:20:14.935851 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.935810    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:14.936044 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.935857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:14.936044 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:14.935971    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rv8z\" (UniqueName: \"kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.036478 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.036441    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.036691 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.036486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.036691 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.036536    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rv8z\" (UniqueName: \"kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.036691 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:20:15.036669    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-serving-cert: secret "maas-api-e2e-api-b-015d51-serving-cert" not found
Jul 25 01:20:15.036872 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:20:15.036785    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls podName:1b9dfcb9-d875-44c3-b44d-91a062146e93 nodeName:}" failed. No retries permitted until 2026-07-25 01:20:15.536736672 +0000 UTC m=+2655.584464647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls") pod "maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" (UID: "1b9dfcb9-d875-44c3-b44d-91a062146e93") : secret "maas-api-e2e-api-b-015d51-serving-cert" not found
Jul 25 01:20:15.037185 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.037164    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.046164 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.046142    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rv8z\" (UniqueName: \"kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.541697 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.541662    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.544028 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.544001    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") pod \"maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.774095 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.774040    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:15.950364 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.950339    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:20:15.953124 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:20:15.953095    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9dfcb9_d875_44c3_b44d_91a062146e93.slice/crio-55cd57b3eda15acc5df2cef3478426986e30e22923870e35c65515e3e94ccbb5 WatchSource:0}: Error finding container 55cd57b3eda15acc5df2cef3478426986e30e22923870e35c65515e3e94ccbb5: Status 404 returned error can't find the container with id 55cd57b3eda15acc5df2cef3478426986e30e22923870e35c65515e3e94ccbb5
Jul 25 01:20:15.954560 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:15.954541    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:20:16.804376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:16.804332    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" event={"ID":"1b9dfcb9-d875-44c3-b44d-91a062146e93","Type":"ContainerStarted","Data":"ca4cffd13b5f269a969de9230fe7541a5c3d324e0097496460dbd8fe35742bdc"}
Jul 25 01:20:16.804376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:16.804382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" event={"ID":"1b9dfcb9-d875-44c3-b44d-91a062146e93","Type":"ContainerStarted","Data":"55cd57b3eda15acc5df2cef3478426986e30e22923870e35c65515e3e94ccbb5"}
Jul 25 01:20:16.804622 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:16.804452    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:16.853539 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:16.853444    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" podStartSLOduration=2.246428497 podStartE2EDuration="2.853428485s" totalImagesPullingTime="606.999988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:20:16.851108681 +0000 UTC m=+2656.898836673" watchObservedRunningTime="2026-07-25 01:20:16.853428485 +0000 UTC m=+2656.901156481"
Jul 25 01:20:22.814726 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:22.814697    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:20:32.893206 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.893172    2574 generic.go:356] "Generic (PLEG): container finished" podID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerID="d2e279009cc48a4b54ea301410af02cea07dcb02dcd3b23b705afeac466c1368" exitCode=0
Jul 25 01:20:32.893679 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.893256    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerDied","Data":"d2e279009cc48a4b54ea301410af02cea07dcb02dcd3b23b705afeac466c1368"}
Jul 25 01:20:32.893679 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.893646    2574 scope.go:117] "RemoveContainer" containerID="d2e279009cc48a4b54ea301410af02cea07dcb02dcd3b23b705afeac466c1368"
Jul 25 01:20:32.894659 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.894633    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:32.894767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.894714    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:32.894767 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:32.894758    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:20:33.899720 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:33.899683    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerStarted","Data":"f3bbc051525752bc7b87357b15c7d31fc2af579d12351bb59b4f2e06b92b5753"}
Jul 25 01:20:34.081766 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:34.081721    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:34.082050 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:34.081948    2574 patch_prober.go:28] interesting pod/e2e-api-b-015d51-openshift-default-567587d498-8c2wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 25 01:20:34.082050 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:34.082021    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 25 01:20:35.081393 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:35.081362    2574 patch_prober.go:28] interesting pod/e2e-api-b-015d51-openshift-default-567587d498-8c2wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 25 01:20:35.081789 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:35.081417    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 25 01:20:36.082325 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:36.082286    2574 patch_prober.go:28] interesting pod/e2e-api-b-015d51-openshift-default-567587d498-8c2wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 25 01:20:36.082759 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:36.082346    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 25 01:20:37.082019 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:37.081974    2574 patch_prober.go:28] interesting pod/e2e-api-b-015d51-openshift-default-567587d498-8c2wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 25 01:20:37.082250 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:37.082046    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 25 01:20:38.084820 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:38.084787    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:38.085230 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:38.085072    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:20:38.085701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:20:38.085681    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:21:09.930086 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:09.930032    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:21:09.930726 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:09.930346    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" podUID="1b9dfcb9-d875-44c3-b44d-91a062146e93" containerName="maas-api" containerID="cri-o://ca4cffd13b5f269a969de9230fe7541a5c3d324e0097496460dbd8fe35742bdc" gracePeriod=30
Jul 25 01:21:10.063836 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.063804    2574 generic.go:356] "Generic (PLEG): container finished" podID="1b9dfcb9-d875-44c3-b44d-91a062146e93" containerID="ca4cffd13b5f269a969de9230fe7541a5c3d324e0097496460dbd8fe35742bdc" exitCode=0
Jul 25 01:21:10.063979 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.063845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" event={"ID":"1b9dfcb9-d875-44c3-b44d-91a062146e93","Type":"ContainerDied","Data":"ca4cffd13b5f269a969de9230fe7541a5c3d324e0097496460dbd8fe35742bdc"}
Jul 25 01:21:10.188429 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.188368    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:21:10.246474 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.246445    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rv8z\" (UniqueName: \"kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z\") pod \"1b9dfcb9-d875-44c3-b44d-91a062146e93\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") "
Jul 25 01:21:10.246666 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.246513    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") pod \"1b9dfcb9-d875-44c3-b44d-91a062146e93\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") "
Jul 25 01:21:10.246666 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.246534    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca\") pod \"1b9dfcb9-d875-44c3-b44d-91a062146e93\" (UID: \"1b9dfcb9-d875-44c3-b44d-91a062146e93\") "
Jul 25 01:21:10.246949 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.246922    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b9dfcb9-d875-44c3-b44d-91a062146e93" (UID: "1b9dfcb9-d875-44c3-b44d-91a062146e93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:21:10.248564 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.248543    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z" (OuterVolumeSpecName: "kube-api-access-2rv8z") pod "1b9dfcb9-d875-44c3-b44d-91a062146e93" (UID: "1b9dfcb9-d875-44c3-b44d-91a062146e93"). InnerVolumeSpecName "kube-api-access-2rv8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:21:10.248658 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.248624    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b9dfcb9-d875-44c3-b44d-91a062146e93" (UID: "1b9dfcb9-d875-44c3-b44d-91a062146e93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:21:10.347874 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.347841    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b9dfcb9-d875-44c3-b44d-91a062146e93-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:10.347874 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.347868    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9dfcb9-d875-44c3-b44d-91a062146e93-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:10.347874 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:10.347879    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rv8z\" (UniqueName: \"kubernetes.io/projected/1b9dfcb9-d875-44c3-b44d-91a062146e93-kube-api-access-2rv8z\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:11.069507 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:11.069469    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9" event={"ID":"1b9dfcb9-d875-44c3-b44d-91a062146e93","Type":"ContainerDied","Data":"55cd57b3eda15acc5df2cef3478426986e30e22923870e35c65515e3e94ccbb5"}
Jul 25 01:21:11.070019 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:11.069532    2574 scope.go:117] "RemoveContainer" containerID="ca4cffd13b5f269a969de9230fe7541a5c3d324e0097496460dbd8fe35742bdc"
Jul 25 01:21:11.070019 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:11.069490    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"
Jul 25 01:21:11.085717 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:11.085692    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:21:11.090728 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:11.090702    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-015d51-78dbb9c46c-qmtv9"]
Jul 25 01:21:12.522076 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:12.522038    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9dfcb9-d875-44c3-b44d-91a062146e93" path="/var/lib/kubelet/pods/1b9dfcb9-d875-44c3-b44d-91a062146e93/volumes"
Jul 25 01:21:20.949309 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:20.949268    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:21:20.949804 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:20.949510    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" containerID="cri-o://f3bbc051525752bc7b87357b15c7d31fc2af579d12351bb59b4f2e06b92b5753" gracePeriod=30
Jul 25 01:21:23.087977 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:23.087936    2574 patch_prober.go:28] interesting pod/e2e-api-b-015d51-openshift-default-567587d498-8c2wr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 01:21:23.088363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:23.087993    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 01:21:26.139639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.139582    2574 generic.go:356] "Generic (PLEG): container finished" podID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerID="f3bbc051525752bc7b87357b15c7d31fc2af579d12351bb59b4f2e06b92b5753" exitCode=0
Jul 25 01:21:26.139639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.139620    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerDied","Data":"f3bbc051525752bc7b87357b15c7d31fc2af579d12351bb59b4f2e06b92b5753"}
Jul 25 01:21:26.140182 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.139700    2574 scope.go:117] "RemoveContainer" containerID="d2e279009cc48a4b54ea301410af02cea07dcb02dcd3b23b705afeac466c1368"
Jul 25 01:21:26.203375 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.203351    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:21:26.286991 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.286907    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.286991 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.286961    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.286991 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.286980    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287016    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287042    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287146    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287175    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhmvg\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287274 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287229    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket\") pod \"d66f3aea-ec54-41a6-8253-87c6791f353b\" (UID: \"d66f3aea-ec54-41a6-8253-87c6791f353b\") "
Jul 25 01:21:26.287577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287536    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:21:26.287577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287565    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:21:26.287760 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287710    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:21:26.287760 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287751    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:21:26.288007 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.287988    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:21:26.289553 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.289525    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:21:26.289670 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.289584    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg" (OuterVolumeSpecName: "kube-api-access-dhmvg") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "kube-api-access-dhmvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:21:26.289745 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.289640    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:21:26.289745 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.289656    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d66f3aea-ec54-41a6-8253-87c6791f353b" (UID: "d66f3aea-ec54-41a6-8253-87c6791f353b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:21:26.388268 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388232    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388268 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388263    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388268 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388272    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d66f3aea-ec54-41a6-8253-87c6791f353b-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388283    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388292    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388300    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388307    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388316    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhmvg\" (UniqueName: \"kubernetes.io/projected/d66f3aea-ec54-41a6-8253-87c6791f353b-kube-api-access-dhmvg\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:26.388496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:26.388325    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d66f3aea-ec54-41a6-8253-87c6791f353b-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:21:27.146044 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:27.146004    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr" event={"ID":"d66f3aea-ec54-41a6-8253-87c6791f353b","Type":"ContainerDied","Data":"d3be8cc6e61b079530996d2eb04f3a9fbccb475572a4e6cf156ba6754e7c5898"}
Jul 25 01:21:27.146566 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:27.146090    2574 scope.go:117] "RemoveContainer" containerID="f3bbc051525752bc7b87357b15c7d31fc2af579d12351bb59b4f2e06b92b5753"
Jul 25 01:21:27.146566 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:27.146018    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"
Jul 25 01:21:27.168738 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:27.168709    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:21:27.173000 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:27.172976    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-015d51-openshift-default-567587d498-8c2wr"]
Jul 25 01:21:28.521375 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:28.521335    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" path="/var/lib/kubelet/pods/d66f3aea-ec54-41a6-8253-87c6791f353b/volumes"
Jul 25 01:21:30.171255 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171220    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:21:30.171639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171608    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.171639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171621    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.171639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171634    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.171639 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171639    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.171780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171660    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9dfcb9-d875-44c3-b44d-91a062146e93" containerName="maas-api"
Jul 25 01:21:30.171780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171667    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9dfcb9-d875-44c3-b44d-91a062146e93" containerName="maas-api"
Jul 25 01:21:30.171780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171716    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9dfcb9-d875-44c3-b44d-91a062146e93" containerName="maas-api"
Jul 25 01:21:30.171780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171725    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.171780 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.171732    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66f3aea-ec54-41a6-8253-87c6791f353b" containerName="istio-proxy"
Jul 25 01:21:30.176111 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.176090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.178819 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.178796    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d50ef4-openshift-default-dockercfg-l89x5\""
Jul 25 01:21:30.187347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.187322    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:21:30.330898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.330857    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlkrm\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.330898 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.330899    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331196 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331016    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331196 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331196 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331392 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.331430 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.331406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.432952 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.432858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.432952 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.432909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.432952 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.432950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.432970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.432985    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433025    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlkrm\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433494    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433550    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433772 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.433887 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.433865    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.435387 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.435364    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.435546 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.435530    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.440821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.440796    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.440903 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.440876    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlkrm\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm\") pod \"e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") " pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.488254 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.488226    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:30.626528 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.626495    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:21:30.628199 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:21:30.628169    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2cca8f_1fe0_4f24_8129_2ac8f3591170.slice/crio-3132caf9d4cc4850b208de17ff0517e1a1c2043b78a3b146ab9ce07dd80b2cb8 WatchSource:0}: Error finding container 3132caf9d4cc4850b208de17ff0517e1a1c2043b78a3b146ab9ce07dd80b2cb8: Status 404 returned error can't find the container with id 3132caf9d4cc4850b208de17ff0517e1a1c2043b78a3b146ab9ce07dd80b2cb8
Jul 25 01:21:30.630400 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.630363    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:30.630478 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.630447    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:30.630515 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:30.630497    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:31.168653 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:31.168615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerStarted","Data":"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"}
Jul 25 01:21:31.168836 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:31.168680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerStarted","Data":"3132caf9d4cc4850b208de17ff0517e1a1c2043b78a3b146ab9ce07dd80b2cb8"}
Jul 25 01:21:31.190351 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:31.190301    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podStartSLOduration=1.190285012 podStartE2EDuration="1.190285012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:21:31.188750472 +0000 UTC m=+2731.236478480" watchObservedRunningTime="2026-07-25 01:21:31.190285012 +0000 UTC m=+2731.238013064"
Jul 25 01:21:31.488740 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:31.488709    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:31.493591 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:31.493567    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:32.172914 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:32.172882    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:32.173886 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:32.173864    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:48.214234 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:48.214188    2574 patch_prober.go:28] interesting pod/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 01:21:48.214695 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:48.214253    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:21:49.252796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.252762    2574 generic.go:356] "Generic (PLEG): container finished" podID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerID="f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49" exitCode=0
Jul 25 01:21:49.253275 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.252816    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerDied","Data":"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"}
Jul 25 01:21:49.253275 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.253223    2574 scope.go:117] "RemoveContainer" containerID="f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"
Jul 25 01:21:49.254328 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.254297    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:49.254398 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.254371    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:49.254436 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:49.254408    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:21:50.264617 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:50.263551    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerStarted","Data":"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"}
Jul 25 01:21:50.488502 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:50.488461    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:50.488855 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:50.488829    2574 patch_prober.go:28] interesting pod/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 25 01:21:50.488916 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:50.488895    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 25 01:21:51.489534 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.489495    2574 patch_prober.go:28] interesting pod/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 25 01:21:51.490030 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.489576    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 25 01:21:51.494978 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.494949    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:21:51.498907 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.498886    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.503132 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.503108    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"kube-root-ca.crt\""
Jul 25 01:21:51.503252 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.503145    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"default-dockercfg-58sdk\""
Jul 25 01:21:51.503252 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.503194    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"openshift-service-ca.crt\""
Jul 25 01:21:51.503252 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.503146    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"auth-test-model-a1fe77-kserve-self-signed-certs\""
Jul 25 01:21:51.506415 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.506158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:21:51.529263 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529232    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.529415 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.529415 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529359    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.529415 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529382    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.529415 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ljh9\" (UniqueName: \"kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.529556 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.529434    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630579 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630545    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630588    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ljh9\" (UniqueName: \"kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630647    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630675    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.630765 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.630709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.631177 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.631142    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.631276 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.631159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.631276 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.631199    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.632941 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.632919    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.633209 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.633194    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.638738 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.638717    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ljh9\" (UniqueName: \"kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9\") pod \"auth-test-model-a1fe77-kserve-6f68fd564c-lds2k\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") " pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.809597 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.809513    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:21:51.967771 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:51.966437    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:21:51.971863 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:21:51.971832    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod221100e6_baca_4d59_9004_e5e9e42441b6.slice/crio-7a67f40f438352a88a47f4abbe5a95e275982c379dc9fc17264e436d09516c10 WatchSource:0}: Error finding container 7a67f40f438352a88a47f4abbe5a95e275982c379dc9fc17264e436d09516c10: Status 404 returned error can't find the container with id 7a67f40f438352a88a47f4abbe5a95e275982c379dc9fc17264e436d09516c10
Jul 25 01:21:52.276147 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:52.276105    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" event={"ID":"221100e6-baca-4d59-9004-e5e9e42441b6","Type":"ContainerStarted","Data":"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"}
Jul 25 01:21:52.276321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:52.276156    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" event={"ID":"221100e6-baca-4d59-9004-e5e9e42441b6","Type":"ContainerStarted","Data":"7a67f40f438352a88a47f4abbe5a95e275982c379dc9fc17264e436d09516c10"}
Jul 25 01:21:52.293068 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:52.293004    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" podStartSLOduration=1.2929886480000001 podStartE2EDuration="1.292988648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:21:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:21:52.292455469 +0000 UTC m=+2752.340183465" watchObservedRunningTime="2026-07-25 01:21:52.292988648 +0000 UTC m=+2752.340716643"
Jul 25 01:21:52.489429 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:52.489386    2574 patch_prober.go:28] interesting pod/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 25 01:21:52.489588 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:52.489454    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 25 01:21:53.488653 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:53.488611    2574 patch_prober.go:28] interesting pod/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 25 01:21:53.488851 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:53.488667    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 25 01:21:54.492549 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:54.492521    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:54.492987 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:54.492939    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:21:54.493695 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:21:54.493674    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:22:01.809847 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:22:01.809809    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:22:01.810364 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:22:01.810125    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:22:01.822728 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:22:01.822703    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:22:02.331398 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:22:02.331360    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:26:48.808809 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:26:48.808770    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:27:03.827534 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:03.827474    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" podUID="221100e6-baca-4d59-9004-e5e9e42441b6" containerName="main" containerID="cri-o://5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544" gracePeriod=45
Jul 25 01:27:04.080027 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.079968    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:27:04.190178 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190142    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190195    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190291    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190347 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190342    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ljh9\" (UniqueName: \"kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190477 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190412    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190477 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190449    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:27:04.190564 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190506    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home\") pod \"221100e6-baca-4d59-9004-e5e9e42441b6\" (UID: \"221100e6-baca-4d59-9004-e5e9e42441b6\") "
Jul 25 01:27:04.190678 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190656    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache" (OuterVolumeSpecName: "model-cache") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:27:04.190788 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190764    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home" (OuterVolumeSpecName: "home") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:27:04.190847 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190834    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.190897 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.190856    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.192530 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.192497    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9" (OuterVolumeSpecName: "kube-api-access-8ljh9") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "kube-api-access-8ljh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:27:04.192629 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.192508    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:27:04.192629 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.192545    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm" (OuterVolumeSpecName: "dshm") pod "221100e6-baca-4d59-9004-e5e9e42441b6" (UID: "221100e6-baca-4d59-9004-e5e9e42441b6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:27:04.291870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.291830    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.291870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.291863    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/221100e6-baca-4d59-9004-e5e9e42441b6-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.291870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.291874    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/221100e6-baca-4d59-9004-e5e9e42441b6-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.292163 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.291887    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ljh9\" (UniqueName: \"kubernetes.io/projected/221100e6-baca-4d59-9004-e5e9e42441b6-kube-api-access-8ljh9\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:27:04.681725 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.681680    2574 generic.go:356] "Generic (PLEG): container finished" podID="221100e6-baca-4d59-9004-e5e9e42441b6" containerID="5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544" exitCode=0
Jul 25 01:27:04.681890 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.681732    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"
Jul 25 01:27:04.681890 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.681765    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" event={"ID":"221100e6-baca-4d59-9004-e5e9e42441b6","Type":"ContainerDied","Data":"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"}
Jul 25 01:27:04.681890 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.681815    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k" event={"ID":"221100e6-baca-4d59-9004-e5e9e42441b6","Type":"ContainerDied","Data":"7a67f40f438352a88a47f4abbe5a95e275982c379dc9fc17264e436d09516c10"}
Jul 25 01:27:04.681890 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.681839    2574 scope.go:117] "RemoveContainer" containerID="5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"
Jul 25 01:27:04.690855 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.690806    2574 scope.go:117] "RemoveContainer" containerID="5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"
Jul 25 01:27:04.691228 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:27:04.691199    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544\": container with ID starting with 5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544 not found: ID does not exist" containerID="5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"
Jul 25 01:27:04.691364 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.691236    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544"} err="failed to get container status \"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544\": rpc error: code = NotFound desc = could not find container \"5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544\": container with ID starting with 5b94a2b2803fd1db9ebf1023684c579b309da976117715b5af45fbf54f5a1544 not found: ID does not exist"
Jul 25 01:27:04.698146 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.698122    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:27:04.700410 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:04.700385    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/auth-test-model-a1fe77-kserve-6f68fd564c-lds2k"]
Jul 25 01:27:06.522386 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:06.522349    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="221100e6-baca-4d59-9004-e5e9e42441b6" path="/var/lib/kubelet/pods/221100e6-baca-4d59-9004-e5e9e42441b6/volumes"
Jul 25 01:27:21.502735 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.502698    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:27:21.503257 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.503068    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="221100e6-baca-4d59-9004-e5e9e42441b6" containerName="main"
Jul 25 01:27:21.503257 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.503084    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="221100e6-baca-4d59-9004-e5e9e42441b6" containerName="main"
Jul 25 01:27:21.503257 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.503164    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="221100e6-baca-4d59-9004-e5e9e42441b6" containerName="main"
Jul 25 01:27:21.506180 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.506158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.508829 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.508810    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d50ef4\"/\"openshift-service-ca.crt\""
Jul 25 01:27:21.510236 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.510212    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d50ef4\"/\"sub-test-model-d50ef4-kserve-self-signed-certs\""
Jul 25 01:27:21.510397 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.510378    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d50ef4\"/\"kube-root-ca.crt\""
Jul 25 01:27:21.510498 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.510382    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d50ef4\"/\"default-dockercfg-zmhz4\""
Jul 25 01:27:21.515165 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.515143    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:27:21.645873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.645821    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.646123 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.646052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.646197 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.646130    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97cdr\" (UniqueName: \"kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.646301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.646276    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.646364 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.646322    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.646364 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.646354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.746875 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.746837    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747079 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.746883    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97cdr\" (UniqueName: \"kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747079 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747222 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747222 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747125    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747222 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747151    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747510 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747598 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747529    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.747701 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.747681    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.749324 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.749304    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.749845 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.749827    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.756505 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.756431    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97cdr\" (UniqueName: \"kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr\") pod \"sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") " pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.816644 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.816602    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:21.949882 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:21.949844    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:27:21.952798 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:27:21.952769    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod077786d7_1123_4564_b49c_1b58e4758435.slice/crio-8c0f92919f34896b99b4799a685dd6cd7c90bd87847b0920f0597957ebf7cf18 WatchSource:0}: Error finding container 8c0f92919f34896b99b4799a685dd6cd7c90bd87847b0920f0597957ebf7cf18: Status 404 returned error can't find the container with id 8c0f92919f34896b99b4799a685dd6cd7c90bd87847b0920f0597957ebf7cf18
Jul 25 01:27:22.763419 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:22.763376    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" event={"ID":"077786d7-1123-4564-b49c-1b58e4758435","Type":"ContainerStarted","Data":"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"}
Jul 25 01:27:22.763796 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:22.763424    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" event={"ID":"077786d7-1123-4564-b49c-1b58e4758435","Type":"ContainerStarted","Data":"8c0f92919f34896b99b4799a685dd6cd7c90bd87847b0920f0597957ebf7cf18"}
Jul 25 01:27:22.779704 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:22.779652    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" podStartSLOduration=1.7796381970000001 podStartE2EDuration="1.779638197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:27:22.778666748 +0000 UTC m=+3082.826394745" watchObservedRunningTime="2026-07-25 01:27:22.779638197 +0000 UTC m=+3082.827366191"
Jul 25 01:27:31.817125 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:31.817089    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:31.817529 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:31.817145    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:31.829559 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:31.829533    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:27:32.820131 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:27:32.820093    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:28:25.404924 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:25.404849    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:28:40.423698 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.423639    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" podUID="077786d7-1123-4564-b49c-1b58e4758435" containerName="main" containerID="cri-o://a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19" gracePeriod=45
Jul 25 01:28:40.674089 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.674008    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:28:40.754923 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.754885    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755123 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.754933    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755123 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.754961    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755123 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755000    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755123 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755040    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755138    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97cdr\" (UniqueName: \"kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr\") pod \"077786d7-1123-4564-b49c-1b58e4758435\" (UID: \"077786d7-1123-4564-b49c-1b58e4758435\") "
Jul 25 01:28:40.755312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755241    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache" (OuterVolumeSpecName: "model-cache") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:28:40.755312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755261    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:28:40.755471 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755426    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home" (OuterVolumeSpecName: "home") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:28:40.755549 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755530    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:40.755608 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.755556    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:40.757344 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.757308    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm" (OuterVolumeSpecName: "dshm") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:28:40.757344 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.757345    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr" (OuterVolumeSpecName: "kube-api-access-97cdr") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "kube-api-access-97cdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:28:40.757509 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.757409    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "077786d7-1123-4564-b49c-1b58e4758435" (UID: "077786d7-1123-4564-b49c-1b58e4758435"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:28:40.856267 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.856229    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97cdr\" (UniqueName: \"kubernetes.io/projected/077786d7-1123-4564-b49c-1b58e4758435-kube-api-access-97cdr\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:40.856267 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.856261    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077786d7-1123-4564-b49c-1b58e4758435-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:40.856267 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.856272    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:40.856500 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:40.856279    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077786d7-1123-4564-b49c-1b58e4758435-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:28:41.121099 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.121041    2574 generic.go:356] "Generic (PLEG): container finished" podID="077786d7-1123-4564-b49c-1b58e4758435" containerID="a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19" exitCode=0
Jul 25 01:28:41.121313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.121106    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"
Jul 25 01:28:41.121313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.121136    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" event={"ID":"077786d7-1123-4564-b49c-1b58e4758435","Type":"ContainerDied","Data":"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"}
Jul 25 01:28:41.121313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.121190    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf" event={"ID":"077786d7-1123-4564-b49c-1b58e4758435","Type":"ContainerDied","Data":"8c0f92919f34896b99b4799a685dd6cd7c90bd87847b0920f0597957ebf7cf18"}
Jul 25 01:28:41.121313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.121214    2574 scope.go:117] "RemoveContainer" containerID="a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"
Jul 25 01:28:41.129805 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.129785    2574 scope.go:117] "RemoveContainer" containerID="a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"
Jul 25 01:28:41.130081 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:28:41.130045    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19\": container with ID starting with a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19 not found: ID does not exist" containerID="a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"
Jul 25 01:28:41.130146 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.130090    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19"} err="failed to get container status \"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19\": rpc error: code = NotFound desc = could not find container \"a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19\": container with ID starting with a200f8a8fa5e51b53ed617a6c859af5248d395fb918e1141f8c39817e5e0db19 not found: ID does not exist"
Jul 25 01:28:41.142696 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.142674    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:28:41.144338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.144316    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d50ef4/sub-test-model-d50ef4-kserve-6d4b877d67-pr6nf"]
Jul 25 01:28:41.786799 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.786765    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:28:41.787339 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.787318    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077786d7-1123-4564-b49c-1b58e4758435" containerName="main"
Jul 25 01:28:41.787434 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.787341    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="077786d7-1123-4564-b49c-1b58e4758435" containerName="main"
Jul 25 01:28:41.787488 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.787460    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="077786d7-1123-4564-b49c-1b58e4758435" containerName="main"
Jul 25 01:28:41.791629 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.791608    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.795475 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.795441    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"kube-root-ca.crt\""
Jul 25 01:28:41.795655 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.795477    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"default-dockercfg-58sdk\""
Jul 25 01:28:41.795655 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.795504    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"openshift-service-ca.crt\""
Jul 25 01:28:41.795655 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.795482    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a1fe77\"/\"rate-test-model-a1fe77-kserve-self-signed-certs\""
Jul 25 01:28:41.800733 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.800709    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:28:41.867020 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.866991    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.867020 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.867027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjh7\" (UniqueName: \"kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.867293 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.867079    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.867293 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.867166    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.867293 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.867202    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.867293 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.867277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.968620 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.968620 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjh7\" (UniqueName: \"kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.968875 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968642    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.968875 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968772    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.968875 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.969022 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.968890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.969085 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.969030    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.969130 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.969115    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.969189 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.969163    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.971011 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.970982    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.971301 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.971285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:41.979256 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:41.979227    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjh7\" (UniqueName: \"kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7\") pod \"rate-test-model-a1fe77-kserve-54c5899b4c-w728h\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") " pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:42.101595 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:42.101502    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:42.230913 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:42.230890    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:28:42.233074 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:28:42.233035    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab577ad9_d0b4_44f5_9c81_e2d79037a9ba.slice/crio-d1f7e276ad4cad2fd0ab3cff87816b5bcfb1f017c8643890f3e9a634dc211790 WatchSource:0}: Error finding container d1f7e276ad4cad2fd0ab3cff87816b5bcfb1f017c8643890f3e9a634dc211790: Status 404 returned error can't find the container with id d1f7e276ad4cad2fd0ab3cff87816b5bcfb1f017c8643890f3e9a634dc211790
Jul 25 01:28:42.526713 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:42.526674    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="077786d7-1123-4564-b49c-1b58e4758435" path="/var/lib/kubelet/pods/077786d7-1123-4564-b49c-1b58e4758435/volumes"
Jul 25 01:28:43.132781 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:43.132748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" event={"ID":"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba","Type":"ContainerStarted","Data":"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"}
Jul 25 01:28:43.132781 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:43.132787    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" event={"ID":"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba","Type":"ContainerStarted","Data":"d1f7e276ad4cad2fd0ab3cff87816b5bcfb1f017c8643890f3e9a634dc211790"}
Jul 25 01:28:43.150485 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:43.150429    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" podStartSLOduration=2.150413403 podStartE2EDuration="2.150413403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:28:43.14880569 +0000 UTC m=+3163.196533685" watchObservedRunningTime="2026-07-25 01:28:43.150413403 +0000 UTC m=+3163.198141389"
Jul 25 01:28:52.101892 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:52.101843    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:52.102429 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:52.101912    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:52.114412 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:52.114387    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:28:52.185552 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:28:52.185519    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:30:20.231431 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:20.231397    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:30:35.249950 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.249907    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" podUID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" containerName="main" containerID="cri-o://41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4" gracePeriod=45
Jul 25 01:30:35.498432 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.498395    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:30:35.594226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594140    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njjh7\" (UniqueName: \"kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594238    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594255    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594317    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594373    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs\") pod \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\" (UID: \"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba\") "
Jul 25 01:30:35.594673 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594549    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:30:35.594673 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594564    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home" (OuterVolumeSpecName: "home") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:30:35.594673 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594592    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:30:35.594829 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594803    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:35.594829 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594824    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:35.594945 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.594839    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:35.596465 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.596446    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7" (OuterVolumeSpecName: "kube-api-access-njjh7") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "kube-api-access-njjh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:30:35.596821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.596790    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm" (OuterVolumeSpecName: "dshm") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:30:35.596821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.596806    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" (UID: "ab577ad9-d0b4-44f5-9c81-e2d79037a9ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:30:35.637713 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.637684    2574 generic.go:356] "Generic (PLEG): container finished" podID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" containerID="41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4" exitCode=0
Jul 25 01:30:35.637854 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.637724    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"
Jul 25 01:30:35.637854 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.637775    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" event={"ID":"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba","Type":"ContainerDied","Data":"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"}
Jul 25 01:30:35.637854 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.637814    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h" event={"ID":"ab577ad9-d0b4-44f5-9c81-e2d79037a9ba","Type":"ContainerDied","Data":"d1f7e276ad4cad2fd0ab3cff87816b5bcfb1f017c8643890f3e9a634dc211790"}
Jul 25 01:30:35.637854 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.637831    2574 scope.go:117] "RemoveContainer" containerID="41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"
Jul 25 01:30:35.646477 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.646458    2574 scope.go:117] "RemoveContainer" containerID="41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"
Jul 25 01:30:35.646733 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:30:35.646715    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4\": container with ID starting with 41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4 not found: ID does not exist" containerID="41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"
Jul 25 01:30:35.646783 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.646741    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4"} err="failed to get container status \"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4\": rpc error: code = NotFound desc = could not find container \"41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4\": container with ID starting with 41c090f7f1a2fadd1742a13161bb0356b00f00c976a2460f22632b9a7c2c9ff4 not found: ID does not exist"
Jul 25 01:30:35.660507 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.660483    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:30:35.664440 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.664413    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a1fe77/rate-test-model-a1fe77-kserve-54c5899b4c-w728h"]
Jul 25 01:30:35.696138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.696112    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:35.696138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.696135    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:35.696276 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:35.696150    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njjh7\" (UniqueName: \"kubernetes.io/projected/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba-kube-api-access-njjh7\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:30:36.521598 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:36.521561    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" path="/var/lib/kubelet/pods/ab577ad9-d0b4-44f5-9c81-e2d79037a9ba/volumes"
Jul 25 01:30:40.721254 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.721219    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:30:40.721758 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.721739    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" containerName="main"
Jul 25 01:30:40.721810 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.721763    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" containerName="main"
Jul 25 01:30:40.721891 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.721879    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab577ad9-d0b4-44f5-9c81-e2d79037a9ba" containerName="main"
Jul 25 01:30:40.727439 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.727420    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.730384 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.730356    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7b2fa1-openshift-default-dockercfg-vmgjw\""
Jul 25 01:30:40.733235 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.733208    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:30:40.852037 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852003    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852326 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852387 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852424 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852529 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852506    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtwg4\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852677 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852663    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852724 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852706    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.852758 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.852729    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953551 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953551 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953551    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953577    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953608    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953643    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtwg4\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.953803 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.953759    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.954229 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.954083    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.954229 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.954169    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.954229 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.954201    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.954460 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.954436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.954537 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.954514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.955870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.955832    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.956112 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.956093    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.961546 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.961523    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:40.961771 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:40.961752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtwg4\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4\") pod \"e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") " pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:41.039338 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.039254    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:41.174348 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.174319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:30:41.176005 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:30:41.175980    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb9a698_f829_4e0f_be82_30016b04ed29.slice/crio-9606355f871bf6a85b0243e9d6cbcb9d8f7bd691ecffdfdd0e5f7660863498db WatchSource:0}: Error finding container 9606355f871bf6a85b0243e9d6cbcb9d8f7bd691ecffdfdd0e5f7660863498db: Status 404 returned error can't find the container with id 9606355f871bf6a85b0243e9d6cbcb9d8f7bd691ecffdfdd0e5f7660863498db
Jul 25 01:30:41.178131 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.178101    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:30:41.178209 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.178163    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:30:41.178209 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.178196    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:30:41.667097 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.667044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerStarted","Data":"c196f237200c8fc1d9e08a2fc10853a452a115e1c351b391bbe0b96cd69a63ad"}
Jul 25 01:30:41.667281 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.667120    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerStarted","Data":"9606355f871bf6a85b0243e9d6cbcb9d8f7bd691ecffdfdd0e5f7660863498db"}
Jul 25 01:30:41.687987 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:41.687932    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podStartSLOduration=1.6879169950000001 podStartE2EDuration="1.687916995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:30:41.686483438 +0000 UTC m=+3281.734211434" watchObservedRunningTime="2026-07-25 01:30:41.687916995 +0000 UTC m=+3281.735644989"
Jul 25 01:30:42.040313 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:42.040269    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:42.045186 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:42.045163    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:42.672244 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:42.672212    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:42.673321 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:42.673301    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:30:43.838392 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.838355    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:30:43.842238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.842219    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.844615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.844591    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-7b2fa1-serving-cert\""
Jul 25 01:30:43.853759 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.853731    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:30:43.878362 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.878333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.878524 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.878372    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884pp\" (UniqueName: \"kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.878524 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.878447    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.978909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.978875    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.979125 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.978922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884pp\" (UniqueName: \"kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.979125 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:30:43.979021    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-serving-cert: secret "maas-api-e2e-ipp-a-7b2fa1-serving-cert" not found
Jul 25 01:30:43.979125 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.979034    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.979125 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:30:43.979112    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls podName:e7ddc4dc-6e08-47b9-acb2-d190b3ce9775 nodeName:}" failed. No retries permitted until 2026-07-25 01:30:44.479091638 +0000 UTC m=+3284.526819614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls") pod "maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" (UID: "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775") : secret "maas-api-e2e-ipp-a-7b2fa1-serving-cert" not found
Jul 25 01:30:43.979661 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.979644    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:43.987678 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:43.987654    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-884pp\" (UniqueName: \"kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:44.484324 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:44.484294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:44.486691 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:44.486662    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") pod \"maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:44.752710 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:44.752616    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:44.884618 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:44.884590    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:30:44.886507 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:30:44.886479    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ddc4dc_6e08_47b9_acb2_d190b3ce9775.slice/crio-f7013e968714f20016827425501fa4cebfa9f39a1ddc7a6cb69e2395cfab6a9d WatchSource:0}: Error finding container f7013e968714f20016827425501fa4cebfa9f39a1ddc7a6cb69e2395cfab6a9d: Status 404 returned error can't find the container with id f7013e968714f20016827425501fa4cebfa9f39a1ddc7a6cb69e2395cfab6a9d
Jul 25 01:30:44.888048 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:44.888030    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 25 01:30:45.687076 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:45.687025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" event={"ID":"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775","Type":"ContainerStarted","Data":"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"}
Jul 25 01:30:45.687238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:45.687098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" event={"ID":"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775","Type":"ContainerStarted","Data":"f7013e968714f20016827425501fa4cebfa9f39a1ddc7a6cb69e2395cfab6a9d"}
Jul 25 01:30:45.687238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:45.687120    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:45.703094 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:45.703027    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" podStartSLOduration=2.096240478 podStartE2EDuration="2.703013841s" totalImagesPullingTime="606.773363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:30:45.702660044 +0000 UTC m=+3285.750388040" watchObservedRunningTime="2026-07-25 01:30:45.703013841 +0000 UTC m=+3285.750741862"
Jul 25 01:30:51.698230 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:51.698200    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:30:58.715246 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:58.715202    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 25 01:30:58.715633 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:30:58.715278    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 25 01:31:00.760909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.760874    2574 generic.go:356] "Generic (PLEG): container finished" podID="acb9a698-f829-4e0f-be82-30016b04ed29" containerID="c196f237200c8fc1d9e08a2fc10853a452a115e1c351b391bbe0b96cd69a63ad" exitCode=0
Jul 25 01:31:00.761335 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.760943    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerDied","Data":"c196f237200c8fc1d9e08a2fc10853a452a115e1c351b391bbe0b96cd69a63ad"}
Jul 25 01:31:00.761382 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.761337    2574 scope.go:117] "RemoveContainer" containerID="c196f237200c8fc1d9e08a2fc10853a452a115e1c351b391bbe0b96cd69a63ad"
Jul 25 01:31:00.762331 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.762305    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:31:00.762454 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.762387    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:31:00.762454 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:00.762446    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:31:01.772695 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:01.772648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerStarted","Data":"42e8adf607b227e43d40861520a1a22d598644488df8583bdd0409c79688d022"}
Jul 25 01:31:02.039714 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:02.039637    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:31:02.039873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:02.039849    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 25 01:31:02.039925 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:02.039898    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 25 01:31:03.039947 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:03.039911    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 25 01:31:03.040379 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:03.039970    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 25 01:31:04.040007 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:04.039969    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 25 01:31:04.040439 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:04.040032    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 25 01:31:05.039730 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:05.039692    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 25 01:31:05.039910 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:05.039757    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 25 01:31:06.042821 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:06.042792    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:31:06.043337 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:06.043045    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:31:06.043790 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:06.043775    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:31:26.589032 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.588941    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:31:26.593008 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.592987    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.595631 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.595607    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7b2fa1\"/\"openshift-service-ca.crt\""
Jul 25 01:31:26.595740 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.595621    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-7b2fa1\"/\"kube-root-ca.crt\""
Jul 25 01:31:26.597219 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.597195    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7b2fa1\"/\"default-dockercfg-pcmz2\""
Jul 25 01:31:26.597388 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.597365    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-7b2fa1\"/\"ipp-route-7b2fa1-kserve-self-signed-certs\""
Jul 25 01:31:26.600018 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.599993    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:31:26.694916 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.694878    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.695150 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.694921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.695150 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.694954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.695150 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.694988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqznq\" (UniqueName: \"kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.695150 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.695017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.695349 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.695203    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.795870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.795835    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.795870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.795874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqznq\" (UniqueName: \"kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.795896    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.795997    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.796044    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796170 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.796135    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796449 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.796427    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796510 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.796450    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.796510 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.796480    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.798253 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.798222    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.798427 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.798397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.803906 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.803887    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqznq\" (UniqueName: \"kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq\") pod \"ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") " pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:26.904451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:26.904363    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:27.058732 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:27.058695    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:31:27.063512 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:31:27.062935    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ea1a893_25af_4131_9019_edd7fb1e1ba7.slice/crio-27cc7b8d9cb4691c54479505489c37f5fba12da94541a87a098ce397ad8e165c WatchSource:0}: Error finding container 27cc7b8d9cb4691c54479505489c37f5fba12da94541a87a098ce397ad8e165c: Status 404 returned error can't find the container with id 27cc7b8d9cb4691c54479505489c37f5fba12da94541a87a098ce397ad8e165c
Jul 25 01:31:27.896650 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:27.896614    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" event={"ID":"0ea1a893-25af-4131-9019-edd7fb1e1ba7","Type":"ContainerStarted","Data":"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"}
Jul 25 01:31:27.897093 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:27.896662    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" event={"ID":"0ea1a893-25af-4131-9019-edd7fb1e1ba7","Type":"ContainerStarted","Data":"27cc7b8d9cb4691c54479505489c37f5fba12da94541a87a098ce397ad8e165c"}
Jul 25 01:31:27.915069 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:27.915000    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" podStartSLOduration=1.914983987 podStartE2EDuration="1.914983987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:31:27.913416311 +0000 UTC m=+3327.961144307" watchObservedRunningTime="2026-07-25 01:31:27.914983987 +0000 UTC m=+3327.962711981"
Jul 25 01:31:36.905418 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:36.905383    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:36.905418 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:36.905425    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:36.918814 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:36.918782    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:31:36.954259 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:31:36.954228    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:32:07.622027 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.621995    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:32:07.625675 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.625658    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.628319 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.628304    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-03dd34-openshift-default-dockercfg-rpcr7\""
Jul 25 01:32:07.638224 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.638200    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:32:07.700901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.700864    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.700911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.700960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5749\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701027    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701099    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701129 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701120    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701359 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701359 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701189    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.701359 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.701257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802650 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802835 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802668    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802835 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802705    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802835 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802722    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5749\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802835 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802769    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.802835 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802813    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803106 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803106 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803106 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.802991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803282 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.803265    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803354 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.803328    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803467 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.803445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803538 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.803466    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.803538 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.803488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.805132 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.805113    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.805533 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.805513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.814360 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.814335    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5749\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.827212 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.827184    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token\") pod \"e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") " pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:07.936256 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:07.936165    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:08.081282 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:08.081257    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:32:08.083116 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:32:08.083048    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bc77b94_7504_408b_8619_c73045e2d5f1.slice/crio-1f7a795c531d603a54f6634e815715dea2c977b18049f257636ba6280290a498 WatchSource:0}: Error finding container 1f7a795c531d603a54f6634e815715dea2c977b18049f257636ba6280290a498: Status 404 returned error can't find the container with id 1f7a795c531d603a54f6634e815715dea2c977b18049f257636ba6280290a498
Jul 25 01:32:08.085268 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:08.085234    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:08.085390 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:08.085297    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:08.085390 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:08.085326    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:09.093378 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:09.093343    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerStarted","Data":"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"}
Jul 25 01:32:09.093792 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:09.093395    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerStarted","Data":"1f7a795c531d603a54f6634e815715dea2c977b18049f257636ba6280290a498"}
Jul 25 01:32:09.119073 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:09.119016    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podStartSLOduration=2.118999885 podStartE2EDuration="2.118999885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-25 01:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:32:09.117419358 +0000 UTC m=+3369.165147355" watchObservedRunningTime="2026-07-25 01:32:09.118999885 +0000 UTC m=+3369.166727879"
Jul 25 01:32:09.936909 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:09.936871    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:09.942113 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:09.942083    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:10.097992 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:10.097954    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:10.098919 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:10.098900    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:30.202332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.202294    2574 generic.go:356] "Generic (PLEG): container finished" podID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerID="273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8" exitCode=0
Jul 25 01:32:30.202818 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.202366    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerDied","Data":"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"}
Jul 25 01:32:30.202818 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.202792    2574 scope.go:117] "RemoveContainer" containerID="273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"
Jul 25 01:32:30.203862 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.203835    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:30.203919 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.203901    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:30.203954 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:30.203936    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 25 01:32:31.210369 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:31.210334    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerStarted","Data":"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"}
Jul 25 01:32:31.936424 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:31.936382    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:31.936632 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:31.936594    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 25 01:32:31.936712 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:31.936646    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 25 01:32:32.937376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:32.937339    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 25 01:32:32.937789 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:32.937412    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 25 01:32:33.937363 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:33.937327    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 25 01:32:33.937539 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:33.937382    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 25 01:32:34.936868 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:34.936830    2574 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 25 01:32:34.937048 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:34.936893    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 25 01:32:35.940766 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:35.940736    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:35.941197 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:35.941021    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:35.941739 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:35.941722    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:53.284184 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:53.284096    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:32:53.284715 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:53.284353    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy" containerID="cri-o://ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf" gracePeriod=30
Jul 25 01:32:58.536387 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.536360    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:58.603238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603154    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603238 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603216    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603288    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603313    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603350    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603373    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603411    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5749\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603447 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603741 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603476    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:32:58.603741 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603493    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert\") pod \"8bc77b94-7504-408b-8619-c73045e2d5f1\" (UID: \"8bc77b94-7504-408b-8619-c73045e2d5f1\") "
Jul 25 01:32:58.603851 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603822    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:32:58.603936 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.603904    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:32:58.604073 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.604034    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:32:58.604138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.604041    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8bc77b94-7504-408b-8619-c73045e2d5f1-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.604138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.604115    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.604138 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.604130    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.604387 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.604359    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data" (OuterVolumeSpecName: "istio-data") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:32:58.605568 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.605539    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:32:58.605711 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.605658    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:32:58.605979 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.605949    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token" (OuterVolumeSpecName: "istio-token") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:32:58.605979 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.605963    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749" (OuterVolumeSpecName: "kube-api-access-f5749") pod "8bc77b94-7504-408b-8619-c73045e2d5f1" (UID: "8bc77b94-7504-408b-8619-c73045e2d5f1"). InnerVolumeSpecName "kube-api-access-f5749". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:32:58.704871 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704820    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.704871 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704864    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.704871 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704873    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.704871 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704884    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5749\" (UniqueName: \"kubernetes.io/projected/8bc77b94-7504-408b-8619-c73045e2d5f1-kube-api-access-f5749\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.705185 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704894    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8bc77b94-7504-408b-8619-c73045e2d5f1-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:58.705185 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:58.704903    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8bc77b94-7504-408b-8619-c73045e2d5f1-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:32:59.340458 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.340421    2574 generic.go:356] "Generic (PLEG): container finished" podID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerID="ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf" exitCode=0
Jul 25 01:32:59.340660 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.340472    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"
Jul 25 01:32:59.340660 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.340499    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerDied","Data":"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"}
Jul 25 01:32:59.340660 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.340554    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm" event={"ID":"8bc77b94-7504-408b-8619-c73045e2d5f1","Type":"ContainerDied","Data":"1f7a795c531d603a54f6634e815715dea2c977b18049f257636ba6280290a498"}
Jul 25 01:32:59.340660 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.340578    2574 scope.go:117] "RemoveContainer" containerID="ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"
Jul 25 01:32:59.350016 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.349996    2574 scope.go:117] "RemoveContainer" containerID="273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"
Jul 25 01:32:59.358526 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.358503    2574 scope.go:117] "RemoveContainer" containerID="ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"
Jul 25 01:32:59.358797 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:32:59.358777    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf\": container with ID starting with ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf not found: ID does not exist" containerID="ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"
Jul 25 01:32:59.358873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.358805    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf"} err="failed to get container status \"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf\": rpc error: code = NotFound desc = could not find container \"ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf\": container with ID starting with ee0894e20ba7dcf77aa52c5908812949eaaa5b823ed7c99c6ebca267dc1c6ecf not found: ID does not exist"
Jul 25 01:32:59.358873 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.358823    2574 scope.go:117] "RemoveContainer" containerID="273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"
Jul 25 01:32:59.359031 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:32:59.359015    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8\": container with ID starting with 273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8 not found: ID does not exist" containerID="273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"
Jul 25 01:32:59.359098 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.359038    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8"} err="failed to get container status \"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8\": rpc error: code = NotFound desc = could not find container \"273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8\": container with ID starting with 273447c0d332969d29516604fbf9f2a25fc8f6afbf145cf943fead3c762ec4a8 not found: ID does not exist"
Jul 25 01:32:59.362198 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.362173    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:32:59.366156 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:32:59.366136    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-03dd34-openshift-default-7fd99cddf6-f67cm"]
Jul 25 01:33:00.522576 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:00.522542    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" path="/var/lib/kubelet/pods/8bc77b94-7504-408b-8619-c73045e2d5f1/volumes"
Jul 25 01:33:12.684907 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:12.684866    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:33:12.685418 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:12.685150    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" podUID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" containerName="maas-api" containerID="cri-o://899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436" gracePeriod=30
Jul 25 01:33:12.938004 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:12.937935    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:33:13.043016 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.042983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca\") pod \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") "
Jul 25 01:33:13.043226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.043053    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") pod \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") "
Jul 25 01:33:13.043226 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.043122    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-884pp\" (UniqueName: \"kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp\") pod \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\" (UID: \"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775\") "
Jul 25 01:33:13.043416 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.043387    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" (UID: "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:33:13.045252 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.045220    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" (UID: "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:33:13.045362 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.045297    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp" (OuterVolumeSpecName: "kube-api-access-884pp") pod "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" (UID: "e7ddc4dc-6e08-47b9-acb2-d190b3ce9775"). InnerVolumeSpecName "kube-api-access-884pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:33:13.144014 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.143963    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-maas-api-tls\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:13.144014 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.144009    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-884pp\" (UniqueName: \"kubernetes.io/projected/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-kube-api-access-884pp\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:13.144014 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.144020    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775-openshift-service-ca\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:13.416360 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.416319    2574 generic.go:356] "Generic (PLEG): container finished" podID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" containerID="899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436" exitCode=0
Jul 25 01:33:13.416360 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.416365    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"
Jul 25 01:33:13.416565 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.416407    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" event={"ID":"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775","Type":"ContainerDied","Data":"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"}
Jul 25 01:33:13.416565 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.416464    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc" event={"ID":"e7ddc4dc-6e08-47b9-acb2-d190b3ce9775","Type":"ContainerDied","Data":"f7013e968714f20016827425501fa4cebfa9f39a1ddc7a6cb69e2395cfab6a9d"}
Jul 25 01:33:13.416565 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.416490    2574 scope.go:117] "RemoveContainer" containerID="899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"
Jul 25 01:33:13.426287 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.426272    2574 scope.go:117] "RemoveContainer" containerID="899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"
Jul 25 01:33:13.426570 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:33:13.426549    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436\": container with ID starting with 899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436 not found: ID does not exist" containerID="899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"
Jul 25 01:33:13.426636 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.426583    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436"} err="failed to get container status \"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436\": rpc error: code = NotFound desc = could not find container \"899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436\": container with ID starting with 899e73b6c21f1d5275bd83e948412d97be04ae38813879b6c364bf5b210e0436 not found: ID does not exist"
Jul 25 01:33:13.438609 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.438584    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:33:13.442285 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:13.442265    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-7b2fa1-6ddbf655b6-mzftc"]
Jul 25 01:33:14.522130 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:14.522097    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" path="/var/lib/kubelet/pods/e7ddc4dc-6e08-47b9-acb2-d190b3ce9775/volumes"
Jul 25 01:33:22.779546 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:22.779508    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:33:37.798795 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:37.798706    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" podUID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" containerName="main" containerID="cri-o://c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752" gracePeriod=45
Jul 25 01:33:38.052773 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.052707    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:33:38.184142 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184107    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqznq\" (UniqueName: \"kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184310 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184198    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184310 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184238    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184310 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184289    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184430 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184312    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184430 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184326    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache\") pod \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\" (UID: \"0ea1a893-25af-4131-9019-edd7fb1e1ba7\") "
Jul 25 01:33:38.184536 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184459    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home" (OuterVolumeSpecName: "home") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:33:38.184680 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184662    2574 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-home\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.184680 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184639    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:33:38.184795 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.184706    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache" (OuterVolumeSpecName: "model-cache") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:33:38.186450 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.186407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm" (OuterVolumeSpecName: "dshm") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:33:38.186450 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.186430    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq" (OuterVolumeSpecName: "kube-api-access-pqznq") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "kube-api-access-pqznq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:33:38.186585 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.186451    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0ea1a893-25af-4131-9019-edd7fb1e1ba7" (UID: "0ea1a893-25af-4131-9019-edd7fb1e1ba7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 25 01:33:38.285469 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.285433    2574 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tls-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.285469 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.285465    2574 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-dshm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.285469 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.285475    2574 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-tmp-dir\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.285738 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.285486    2574 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ea1a893-25af-4131-9019-edd7fb1e1ba7-model-cache\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.285738 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.285499    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqznq\" (UniqueName: \"kubernetes.io/projected/0ea1a893-25af-4131-9019-edd7fb1e1ba7-kube-api-access-pqznq\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:33:38.541999 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.541966    2574 generic.go:356] "Generic (PLEG): container finished" podID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" containerID="c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752" exitCode=0
Jul 25 01:33:38.542167 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.542009    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"
Jul 25 01:33:38.542167 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.542044    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" event={"ID":"0ea1a893-25af-4131-9019-edd7fb1e1ba7","Type":"ContainerDied","Data":"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"}
Jul 25 01:33:38.542167 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.542108    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs" event={"ID":"0ea1a893-25af-4131-9019-edd7fb1e1ba7","Type":"ContainerDied","Data":"27cc7b8d9cb4691c54479505489c37f5fba12da94541a87a098ce397ad8e165c"}
Jul 25 01:33:38.542167 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.542133    2574 scope.go:117] "RemoveContainer" containerID="c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"
Jul 25 01:33:38.550587 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.550570    2574 scope.go:117] "RemoveContainer" containerID="c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"
Jul 25 01:33:38.550835 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:33:38.550816    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752\": container with ID starting with c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752 not found: ID does not exist" containerID="c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"
Jul 25 01:33:38.550895 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.550847    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752"} err="failed to get container status \"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752\": rpc error: code = NotFound desc = could not find container \"c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752\": container with ID starting with c3c2134780c40b0b40e46a5f5b5faf943159d4cffa1bfb7cda021f915751f752 not found: ID does not exist"
Jul 25 01:33:38.559312 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.559291    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:33:38.562805 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:38.562784    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-7b2fa1/ipp-route-7b2fa1-kserve-6f4467bb7-jqdbs"]
Jul 25 01:33:40.522184 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:33:40.522152    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" path="/var/lib/kubelet/pods/0ea1a893-25af-4131-9019-edd7fb1e1ba7/volumes"
Jul 25 01:34:05.491326 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:05.491280    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:34:05.491814 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:05.491548    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" containerID="cri-o://42e8adf607b227e43d40861520a1a22d598644488df8583bdd0409c79688d022" gracePeriod=30
Jul 25 01:34:06.045303 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:06.045256    2574 patch_prober.go:28] interesting pod/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 25 01:34:06.045485 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:06.045344    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 25 01:34:10.691351 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.691319    2574 generic.go:356] "Generic (PLEG): container finished" podID="acb9a698-f829-4e0f-be82-30016b04ed29" containerID="42e8adf607b227e43d40861520a1a22d598644488df8583bdd0409c79688d022" exitCode=0
Jul 25 01:34:10.691772 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.691387    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerDied","Data":"42e8adf607b227e43d40861520a1a22d598644488df8583bdd0409c79688d022"}
Jul 25 01:34:10.691772 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.691443    2574 scope.go:117] "RemoveContainer" containerID="c196f237200c8fc1d9e08a2fc10853a452a115e1c351b391bbe0b96cd69a63ad"
Jul 25 01:34:10.744502 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.744479    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:34:10.891077 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.890974    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891077 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891018    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891077 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891039    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtwg4\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891291 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891092    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891291 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891268    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891327    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891361    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:34:10.891451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891391    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891451 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891430    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891457    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data\") pod \"acb9a698-f829-4e0f-be82-30016b04ed29\" (UID: \"acb9a698-f829-4e0f-be82-30016b04ed29\") "
Jul 25 01:34:10.891682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891442    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:34:10.891682 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891514    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:34:10.891849 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891680    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:34:10.891910 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891876    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.891910 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891895    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acb9a698-f829-4e0f-be82-30016b04ed29-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.891910 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891908    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.892084 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.891921    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.892309 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.892287    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data" (OuterVolumeSpecName: "istio-data") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:34:10.893433 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.893407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token" (OuterVolumeSpecName: "istio-token") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:34:10.893549 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.893503    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:34:10.893711 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.893698    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4" (OuterVolumeSpecName: "kube-api-access-qtwg4") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "kube-api-access-qtwg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:34:10.893826 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.893800    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acb9a698-f829-4e0f-be82-30016b04ed29" (UID: "acb9a698-f829-4e0f-be82-30016b04ed29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:34:10.992481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.992442    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acb9a698-f829-4e0f-be82-30016b04ed29-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.992481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.992474    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.992481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.992483    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acb9a698-f829-4e0f-be82-30016b04ed29-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.992481 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.992491    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtwg4\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-kube-api-access-qtwg4\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:10.992753 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:10.992501    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acb9a698-f829-4e0f-be82-30016b04ed29-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:34:11.704179 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:11.704135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j" event={"ID":"acb9a698-f829-4e0f-be82-30016b04ed29","Type":"ContainerDied","Data":"9606355f871bf6a85b0243e9d6cbcb9d8f7bd691ecffdfdd0e5f7660863498db"}
Jul 25 01:34:11.704613 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:11.704201    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"
Jul 25 01:34:11.704613 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:11.704240    2574 scope.go:117] "RemoveContainer" containerID="42e8adf607b227e43d40861520a1a22d598644488df8583bdd0409c79688d022"
Jul 25 01:34:11.726715 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:11.726686    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:34:11.730281 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:11.730261    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7b2fa1-openshift-default-695cd565fb-sr52j"]
Jul 25 01:34:12.521612 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:34:12.521578    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" path="/var/lib/kubelet/pods/acb9a698-f829-4e0f-be82-30016b04ed29/volumes"
Jul 25 01:35:11.132513 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:11.132480    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:35:11.133020 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:11.132702    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy" containerID="cri-o://826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62" gracePeriod=30
Jul 25 01:35:16.382716 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.382693    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:35:16.401022 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.400961    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401022 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.400997    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401029    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401067    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401155    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlkrm\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401186    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401217    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401248    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401273    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket\") pod \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\" (UID: \"8d2cca8f-1fe0-4f24-8129-2ac8f3591170\") "
Jul 25 01:35:16.401496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401353    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:35:16.401496 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401361    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:35:16.402693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.401568    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:35:16.402693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.402329    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:35:16.402693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.402365    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-credential-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.402693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.402416    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-certs\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.402693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.402436    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-workload-socket\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.402946 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.402720    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 25 01:35:16.404596 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.404561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 25 01:35:16.404880 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.404857    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:35:16.405200 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.405178    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 25 01:35:16.405930 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.405901    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm" (OuterVolumeSpecName: "kube-api-access-xlkrm") pod "8d2cca8f-1fe0-4f24-8129-2ac8f3591170" (UID: "8d2cca8f-1fe0-4f24-8129-2ac8f3591170"). InnerVolumeSpecName "kube-api-access-xlkrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 25 01:35:16.503332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503299    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlkrm\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-kube-api-access-xlkrm\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.503332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503325    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-token\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.503332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503335    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-envoy\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.503332 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503343    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istiod-ca-cert\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.503588 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503351    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-data\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.503588 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.503361    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2cca8f-1fe0-4f24-8129-2ac8f3591170-istio-podinfo\") on node \"ip-10-0-136-9.ec2.internal\" DevicePath \"\""
Jul 25 01:35:16.999038 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.999004    2574 generic.go:356] "Generic (PLEG): container finished" podID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerID="826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62" exitCode=0
Jul 25 01:35:16.999261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.999072    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"
Jul 25 01:35:16.999261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.999104    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerDied","Data":"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"}
Jul 25 01:35:16.999261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.999169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x" event={"ID":"8d2cca8f-1fe0-4f24-8129-2ac8f3591170","Type":"ContainerDied","Data":"3132caf9d4cc4850b208de17ff0517e1a1c2043b78a3b146ab9ce07dd80b2cb8"}
Jul 25 01:35:16.999261 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:16.999205    2574 scope.go:117] "RemoveContainer" containerID="826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"
Jul 25 01:35:17.007962 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.007944    2574 scope.go:117] "RemoveContainer" containerID="f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"
Jul 25 01:35:17.015879 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.015861    2574 scope.go:117] "RemoveContainer" containerID="826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"
Jul 25 01:35:17.016196 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:35:17.016178    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62\": container with ID starting with 826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62 not found: ID does not exist" containerID="826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"
Jul 25 01:35:17.016290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.016203    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62"} err="failed to get container status \"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62\": rpc error: code = NotFound desc = could not find container \"826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62\": container with ID starting with 826cfa9566556b980be7633e5712aabfd60157d9fa86f55790e8f4c5ff29aa62 not found: ID does not exist"
Jul 25 01:35:17.016290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.016220    2574 scope.go:117] "RemoveContainer" containerID="f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"
Jul 25 01:35:17.016471 ip-10-0-136-9 kubenswrapper[2574]: E0725 01:35:17.016448    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49\": container with ID starting with f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49 not found: ID does not exist" containerID="f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"
Jul 25 01:35:17.016577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.016479    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49"} err="failed to get container status \"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49\": rpc error: code = NotFound desc = could not find container \"f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49\": container with ID starting with f42f4f6e91fa839d8fa4ba09fbe3781b1907f1ff0a08aa3680e9180b5c068d49 not found: ID does not exist"
Jul 25 01:35:17.017523 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.017499    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:35:17.019078 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:17.019043    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d50ef4-openshift-default-668978b54d-jfq6x"]
Jul 25 01:35:18.515556 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:18.515522    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b8579fc9-bcsjr_803b08ea-1fec-48a5-b00c-66bd5cbb16fb/copy-manifests/0.log"
Jul 25 01:35:18.521128 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:18.521100    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" path="/var/lib/kubelet/pods/8d2cca8f-1fe0-4f24-8129-2ac8f3591170/volumes"
Jul 25 01:35:18.522901 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:18.522880    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b8579fc9-bcsjr_803b08ea-1fec-48a5-b00c-66bd5cbb16fb/manager/0.log"
Jul 25 01:35:19.177662 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:19.177628    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-54ccd5bb8c-f7795_6761b827-2d52-407d-a84c-06db12c20573/maas-api/0.log"
Jul 25 01:35:21.468171 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:21.468138    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ptpng_e55b7397-e9bd-492c-bf47-58aa8e0a7cc4/kuadrant-console-plugin/0.log"
Jul 25 01:35:22.742221 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:22.742193    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68546f88c4-v9bpz_bb3e719b-3dad-47d8-b20d-2312588eea4c/kube-auth-proxy/0.log"
Jul 25 01:35:22.865968 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:22.865936    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/1.log"
Jul 25 01:35:23.008290 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:23.008215    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-c2pff_aea7f9c4-7232-46d3-a46a-59b017bff6af/payload-pre-processing/0.log"
Jul 25 01:35:23.764693 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:23.764663    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-r7cfj_9f21e0da-9779-47ef-a347-761e61cb809b/main/0.log"
Jul 25 01:35:23.883444 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:23.883415    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gf74r_ae84549c-d465-4199-b8dd-fa36d57cff02/main/0.log"
Jul 25 01:35:24.116186 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:24.116110    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dr9p8_f83b4310-9728-442d-bbff-0774a9438af9/main/0.log"
Jul 25 01:35:24.238388 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:24.238362    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-mbk9z_5db2082f-e60c-4aa5-9a18-b17bee674160/main/0.log"
Jul 25 01:35:32.721613 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:32.721584    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tf6h4_4d5e10ab-478c-4e93-9954-650af6b36ed4/global-pull-secret-syncer/0.log"
Jul 25 01:35:32.874865 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:32.874840    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-72hq9_3a0b8a59-6bc3-4e28-8a8a-fc90850da424/konnectivity-agent/0.log"
Jul 25 01:35:32.930467 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:32.930429    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-9.ec2.internal_9d7ad4a6bb684f22efbfb85f952c0cad/haproxy/0.log"
Jul 25 01:35:37.735122 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:37.735088    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ptpng_e55b7397-e9bd-492c-bf47-58aa8e0a7cc4/kuadrant-console-plugin/0.log"
Jul 25 01:35:40.277728 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.277701    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2rl8q_40ce7f04-89fd-4aed-afad-0c782664962e/node-exporter/0.log"
Jul 25 01:35:40.301943 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.301912    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2rl8q_40ce7f04-89fd-4aed-afad-0c782664962e/kube-rbac-proxy/0.log"
Jul 25 01:35:40.329038 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.329012    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2rl8q_40ce7f04-89fd-4aed-afad-0c782664962e/init-textfile/0.log"
Jul 25 01:35:40.720010 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.719977    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/prometheus/0.log"
Jul 25 01:35:40.743748 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.743725    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/config-reloader/0.log"
Jul 25 01:35:40.780997 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.780970    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/thanos-sidecar/0.log"
Jul 25 01:35:40.807459 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.807425    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/kube-rbac-proxy-web/0.log"
Jul 25 01:35:40.828455 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.828428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/kube-rbac-proxy/0.log"
Jul 25 01:35:40.851214 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.851171    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/kube-rbac-proxy-thanos/0.log"
Jul 25 01:35:40.875198 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.875174    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_91b7fffc-4fcc-4405-ada2-5ea24dabe486/init-config-reloader/0.log"
Jul 25 01:35:40.906440 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.906404    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zlkxk_6a26cb0a-1f72-43fe-83a6-677193af097b/prometheus-operator/0.log"
Jul 25 01:35:40.927531 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:40.927505    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-zlkxk_6a26cb0a-1f72-43fe-83a6-677193af097b/kube-rbac-proxy/0.log"
Jul 25 01:35:43.298213 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.298176    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"]
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299529    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" containerName="maas-api"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299558    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" containerName="maas-api"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299584    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299593    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299631    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299639    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299649    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299656    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299694    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299702    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299712    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" containerName="main"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299719    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" containerName="main"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299905    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea1a893-25af-4131-9019-edd7fb1e1ba7" containerName="main"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299916    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ddc4dc-6e08-47b9-acb2-d190b3ce9775" containerName="maas-api"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299925    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="acb9a698-f829-4e0f-be82-30016b04ed29" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299941    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299956    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299965    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bc77b94-7504-408b-8619-c73045e2d5f1" containerName="istio-proxy"
Jul 25 01:35:43.301577 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.299979    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2cca8f-1fe0-4f24-8129-2ac8f3591170" containerName="istio-proxy"
Jul 25 01:35:43.305590 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.305566    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.308474 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.308450    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bt87\"/\"kube-root-ca.crt\""
Jul 25 01:35:43.308588 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.308453    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bt87\"/\"openshift-service-ca.crt\""
Jul 25 01:35:43.308875 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.308854    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"]
Jul 25 01:35:43.309839 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.309821    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8bt87\"/\"default-dockercfg-jr6f2\""
Jul 25 01:35:43.445230 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.445194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-lib-modules\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.445421 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.445248    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-proc\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.445421 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.445328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-sys\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.445421 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.445344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-podres\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.445421 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.445378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5f6\" (UniqueName: \"kubernetes.io/projected/cfd8080f-5092-4ada-8e28-909a6ee98afd-kube-api-access-rr5f6\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546695 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-sys\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546695 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546697    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-podres\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5f6\" (UniqueName: \"kubernetes.io/projected/cfd8080f-5092-4ada-8e28-909a6ee98afd-kube-api-access-rr5f6\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-lib-modules\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546792    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-sys\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546810    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-proc\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.546870 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-podres\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.547086 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546892    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-lib-modules\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.547086 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.546934    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfd8080f-5092-4ada-8e28-909a6ee98afd-proc\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.554892 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.554846    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5f6\" (UniqueName: \"kubernetes.io/projected/cfd8080f-5092-4ada-8e28-909a6ee98afd-kube-api-access-rr5f6\") pod \"perf-node-gather-daemonset-6pf4x\" (UID: \"cfd8080f-5092-4ada-8e28-909a6ee98afd\") " pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.616151 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.616109    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:43.743969 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:43.743941    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"]
Jul 25 01:35:43.746237 ip-10-0-136-9 kubenswrapper[2574]: W0725 01:35:43.746204    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcfd8080f_5092_4ada_8e28_909a6ee98afd.slice/crio-51f6c1c8407e6ef0a0dccfd26ceab013f4228fa720c644bc931d50bfe4958485 WatchSource:0}: Error finding container 51f6c1c8407e6ef0a0dccfd26ceab013f4228fa720c644bc931d50bfe4958485: Status 404 returned error can't find the container with id 51f6c1c8407e6ef0a0dccfd26ceab013f4228fa720c644bc931d50bfe4958485
Jul 25 01:35:44.126846 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:44.126757    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x" event={"ID":"cfd8080f-5092-4ada-8e28-909a6ee98afd","Type":"ContainerStarted","Data":"137fa705590853ccfce43958d98b7c9a1b44c772178e87b5ab8c28b83dd04b73"}
Jul 25 01:35:44.126846 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:44.126807    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x" event={"ID":"cfd8080f-5092-4ada-8e28-909a6ee98afd","Type":"ContainerStarted","Data":"51f6c1c8407e6ef0a0dccfd26ceab013f4228fa720c644bc931d50bfe4958485"}
Jul 25 01:35:44.127039 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:44.126890    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:44.446948 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:44.446872    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-l8pbw_61a3da3a-dcb9-4a97-ad68-041e08391127/volume-data-source-validator/0.log"
Jul 25 01:35:45.443232 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:45.443182    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9kmd_1eddaf8e-1986-4e84-8418-1f45a95379f5/dns/0.log"
Jul 25 01:35:45.462590 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:45.462548    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h9kmd_1eddaf8e-1986-4e84-8418-1f45a95379f5/kube-rbac-proxy/0.log"
Jul 25 01:35:45.577688 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:45.577656    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9f4fv_ee98e7ff-4f12-4b4c-a1d4-c314c4a58db1/dns-node-resolver/0.log"
Jul 25 01:35:46.184316 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:46.184284    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c84484f9c-kdtpp_18389799-e3c3-44c5-bd06-d57b20aaab38/registry/0.log"
Jul 25 01:35:46.227403 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:46.227375    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ncbs8_45bad3a3-8404-4ff1-a97b-a59685573ea3/node-ca/0.log"
Jul 25 01:35:47.374703 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:47.374649    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68546f88c4-v9bpz_bb3e719b-3dad-47d8-b20d-2312588eea4c/kube-auth-proxy/0.log"
Jul 25 01:35:47.400733 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:47.400703    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/0.log"
Jul 25 01:35:47.428370 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:47.428333    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/1.log"
Jul 25 01:35:47.458922 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:47.458893    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-c2pff_aea7f9c4-7232-46d3-a46a-59b017bff6af/payload-pre-processing/0.log"
Jul 25 01:35:48.359532 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:48.359505    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jthmf_c13a777b-c88c-4114-bf41-ab5d5a7c203d/serve-healthcheck-canary/0.log"
Jul 25 01:35:48.925065 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:48.925026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88zz5_91f55ebd-21ea-4445-abf8-36ae440afea4/kube-rbac-proxy/0.log"
Jul 25 01:35:48.943171 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:48.943142    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88zz5_91f55ebd-21ea-4445-abf8-36ae440afea4/exporter/0.log"
Jul 25 01:35:48.961615 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:48.961593    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-88zz5_91f55ebd-21ea-4445-abf8-36ae440afea4/extractor/0.log"
Jul 25 01:35:50.141684 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:50.141651    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x"
Jul 25 01:35:50.157611 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:50.157557    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8bt87/perf-node-gather-daemonset-6pf4x" podStartSLOduration=7.157541582 podStartE2EDuration="7.157541582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-25 01:35:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-25 01:35:44.141089972 +0000 UTC m=+3584.188817968" watchObservedRunningTime="2026-07-25 01:35:50.157541582 +0000 UTC m=+3590.205269577"
Jul 25 01:35:51.866074 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:51.866027    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b8579fc9-bcsjr_803b08ea-1fec-48a5-b00c-66bd5cbb16fb/manager/0.log"
Jul 25 01:35:51.884876 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:51.884849    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9b8579fc9-bcsjr_803b08ea-1fec-48a5-b00c-66bd5cbb16fb/copy-manifests/0.log"
Jul 25 01:35:53.577021 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:53.576990    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bd5dcbf9d-6kqmc_887d95a9-30bb-43fc-8251-2ceb9191819f/manager/0.log"
Jul 25 01:35:54.554868 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:54.554834    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68546f88c4-v9bpz_bb3e719b-3dad-47d8-b20d-2312588eea4c/kube-auth-proxy/0.log"
Jul 25 01:35:54.572377 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:54.572328    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/0.log"
Jul 25 01:35:54.599066 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:54.599026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/1.log"
Jul 25 01:35:54.621387 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:54.621360    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-c2pff_aea7f9c4-7232-46d3-a46a-59b017bff6af/payload-pre-processing/0.log"
Jul 25 01:35:56.241751 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:56.241724    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68546f88c4-v9bpz_bb3e719b-3dad-47d8-b20d-2312588eea4c/kube-auth-proxy/0.log"
Jul 25 01:35:56.261206 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:56.261178    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/0.log"
Jul 25 01:35:56.287690 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:56.287649    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wbcf5_03888453-1ee8-4de2-962f-3a9266354cd5/istio-proxy/1.log"
Jul 25 01:35:56.309743 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:56.309712    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-c2pff_aea7f9c4-7232-46d3-a46a-59b017bff6af/payload-pre-processing/0.log"
Jul 25 01:35:58.577485 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:58.577455    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-l642q_f38d19ab-d09c-4bc9-9800-39f7e9f8c97a/migrator/0.log"
Jul 25 01:35:58.596215 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:58.596190    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-l642q_f38d19ab-d09c-4bc9-9800-39f7e9f8c97a/graceful-termination/0.log"
Jul 25 01:35:59.881928 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:35:59.881897    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2bkfs_4869d647-9d6d-4e1a-a004-c5aaf817c4c8/kube-multus/0.log"
Jul 25 01:36:00.198867 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.198785    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/kube-multus-additional-cni-plugins/0.log"
Jul 25 01:36:00.218070 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.218030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/egress-router-binary-copy/0.log"
Jul 25 01:36:00.236752 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.236728    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/cni-plugins/0.log"
Jul 25 01:36:00.255100 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.255070    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/bond-cni-plugin/0.log"
Jul 25 01:36:00.273376 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.273355    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/routeoverride-cni/0.log"
Jul 25 01:36:00.292277 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.292253    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/whereabouts-cni-bincopy/0.log"
Jul 25 01:36:00.310743 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.310720    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nnjl9_4049a5f2-4b8d-4eef-9fc7-d96e787d6153/whereabouts-cni/0.log"
Jul 25 01:36:00.419259 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.419231    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2s69q_cf10a4aa-bf28-4187-b2cd-8e911b7941fd/network-metrics-daemon/0.log"
Jul 25 01:36:00.435933 ip-10-0-136-9 kubenswrapper[2574]: I0725 01:36:00.435906    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2s69q_cf10a4aa-bf28-4187-b2cd-8e911b7941fd/kube-rbac-proxy/0.log"