Jul 23 18:14:22.659105 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 18:14:22.659113 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 18:14:22.659120 ip-10-0-137-146 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 18:14:22.659330 ip-10-0-137-146 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 18:14:31.755338 ip-10-0-137-146 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 18:14:31.755351 ip-10-0-137-146 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bd2b7a2872d546408010d32fb7c6bf0c --
Jul 23 18:16:00.796889 ip-10-0-137-146 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.167657    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172561    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172573    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172576    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172580    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172584    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172587    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172590    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.173948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172593    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172596    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172599    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172602    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172609    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172612    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172615    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172618    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172620    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172623    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172626    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172628    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172631    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172634    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172638    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172642    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172646    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172649    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172652    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172655    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.178685 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172658    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172660    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172663    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172666    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172668    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172671    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172674    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172677    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172680    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172683    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172686    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172689    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172691    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172694    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172697    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172699    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172702    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172705    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172707    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.184579 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172710    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172713    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172717    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172719    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172721    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172724    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172726    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172729    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172732    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172735    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172739    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172743    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172745    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172748    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172750    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172753    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172756    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172758    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172761    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172763    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.189287 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172766    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172769    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172771    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172774    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172776    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172780    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172783    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172785    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172788    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172790    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172793    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172797    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172799    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172802    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172805    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172807    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172810    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172812    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172815    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172817    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.195307 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172819    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172822    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172825    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172828    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172830    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172833    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172835    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172838    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172840    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172843    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172845    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172849    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.172852    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173591    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173598    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173602    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173604    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173607    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173610    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173613    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.199851 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173616    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173619    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173622    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173625    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173628    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173630    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173634    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173638    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173640    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173643    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173645    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173648    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173652    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173655    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173659    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173662    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173665    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173668    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173670    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.207359 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173673    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173675    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173678    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173680    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173683    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173685    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173688    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173690    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173694    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173697    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173699    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173702    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173705    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173708    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173710    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173713    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173716    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173718    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173721    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173723    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.212063 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173726    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173728    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173731    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173733    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173736    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173738    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173741    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173745    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173748    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173752    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173754    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173757    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173760    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173763    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173766    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173768    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173771    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173774    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173777    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.217948 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173779    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173782    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173784    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173787    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173790    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173792    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173795    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173798    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173801    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173804    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173806    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173809    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173811    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173814    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173816    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173819    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173821    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173824    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173827    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173831    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.222219 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173834    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173837    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173840    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173843    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173845    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173848    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173850    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173853    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173855    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173858    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173860    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173862    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173865    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.173868    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174251    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174257    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174260    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174263    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174267    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174270    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.225719 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174273    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174275    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174278    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174280    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174283    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174286    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174288    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174291    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174294    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174296    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174299    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174301    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174304    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174307    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174309    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174312    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174315    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174318    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174321    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174324    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.229572 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174326    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174329    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174332    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174334    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174337    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174339    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174342    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174344    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174347    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174350    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174354    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174358    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174361    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174366    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174369    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174372    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174375    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174378    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174381    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.231513 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174384    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174386    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174389    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174392    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174394    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174397    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174400    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174402    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174405    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174407    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174410    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174412    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174415    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174417    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174420    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174422    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174425    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174427    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174430    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174433    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.235489 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174435    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174438    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174440    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174443    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174445    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174448    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174454    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174457    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174461    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174464    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174467    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174469    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174472    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174491    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174494    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174497    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174499    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174502    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174506    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.237575 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174509    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174511    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174514    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174517    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174519    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174522    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174524    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174527    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174529    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174533    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174537    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174540    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174545    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174548    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.174551    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174625    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174632    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174639    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174643    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174649    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174653    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 18:16:01.242027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174657    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174661    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174664    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174667    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174671    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174674    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174677    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174680    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174683    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174686    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174689    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174692    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174696    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174700    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174703    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174706    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174710    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174714    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174717    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174720    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174723    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174726    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174729    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174734    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 18:16:01.244209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174737    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174740    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174744    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174747    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174750    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174753    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174758    2562 flags.go:64] FLAG: --enable-server="true"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174761    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174765    2562 flags.go:64] FLAG: --event-burst="100"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174769    2562 flags.go:64] FLAG: --event-qps="50"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174772    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174775    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174778    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174781    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174784    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174787    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174790    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174793    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174796    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174799    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174802    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174805    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174808    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174811    2562 flags.go:64] FLAG: --feature-gates=""
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174815    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 18:16:01.248917 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174818    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 18:16:01.248636 ip-10-0-137-146 systemd[1]: Started Kubernetes Kubelet.
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174821    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174824    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174827    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174830    2562 flags.go:64] FLAG: --help="false"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174833    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174840    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174843    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174846    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174849    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174853    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174856    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174858    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174863    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174866    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174870    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174873    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174876    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174879    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174882    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174885    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174889    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174891    2562 flags.go:64] FLAG: --lock-file=""
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174894    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 18:16:01.268418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174897    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174900    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174906    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174909    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174911    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174914    2562 flags.go:64] FLAG: --logging-format="text"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174917    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174921    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174923    2562 flags.go:64] FLAG: --manifest-url=""
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174931    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174935    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174939    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174943    2562 flags.go:64] FLAG: --max-pods="110"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174946    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174950    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174953    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174956    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174960    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174962    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174965    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174973    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174977    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174980    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 18:16:01.272213 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174984    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174987    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174992    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174995    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.174999    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175002    2562 flags.go:64] FLAG: --port="10250"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175005    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175007    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050917497a982eb23"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175011    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175014    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175017    2562 flags.go:64] FLAG: --register-node="true"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175020    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175023    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175026    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175029    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175032    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175043    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175047    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175050    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175053    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175056    2562 flags.go:64] FLAG: --runonce="false"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175059    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175062    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175067    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175070    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 18:16:01.276099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175073    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175076    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175079    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175082    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175085    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175088    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175092    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175095    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175098    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175102    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175104    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175110    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175113    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175116    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175120    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175123    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175125    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175128    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175131    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175134    2562 flags.go:64] FLAG: --v="2"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175138    2562 flags.go:64] FLAG: --version="false"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175142    2562 flags.go:64] FLAG: --vmodule=""
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175146    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175149    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 18:16:01.281065 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175271    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175275    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175278    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175283    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175287    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175290    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175295    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175298    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175301    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175304    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175307    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175310    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175312    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175315    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175319    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175322    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175325    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175327    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175330    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175333    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.285897 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175336    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175338    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175341    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175343    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175346    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175348    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175351    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175353    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175356    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175358    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175361    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175363    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175366    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175368    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175371    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175373    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175376    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175378    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175382    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175385    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.290391 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175387    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175390    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175392    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175395    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175397    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175400    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175404    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175406    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175409    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175411    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175414    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175417    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175420    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175422    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175425    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175428    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175430    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175433    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175435    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175438    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.293199 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175441    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175445    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175447    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175450    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175452    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175455    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175457    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175461    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175464    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175467    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175472    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175490    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175493    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175496    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175499    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175502    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175504    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175507    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175511    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.294132 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175514    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175516    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175519    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175521    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175524    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175527    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175529    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175532    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175534    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175537    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175539    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175542    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175545    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175547    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175550    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175553    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175555    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175558    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175560    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.295406 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.175563    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.175569    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.183422    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.183443    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.183467    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.183473    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183555    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183560    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183563    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183566    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183571    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183575    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183578    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183581    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.296882 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183584    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183587    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183589    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183592    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183594    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183597    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183600    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183602    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183605    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183608    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183611    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183614    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183616    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183619    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183622    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183625    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183628    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183631    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183633    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183638    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.299251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183641    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183650    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183653    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183655    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183658    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183660    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183663    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183665    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183668    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183670    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183673    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183676    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183678    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183681    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183683    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183686    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183688    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183691    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183693    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183696    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.300017 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183698    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183701    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183704    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183707    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183709    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183712    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183715    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183717    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183720    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183722    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183725    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183729    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183732    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183735    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183743    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183746    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183748    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183751    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183754    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.301664 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183756    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183759    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183761    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183764    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183766    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183769    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183771    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183773    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183776    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183779    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183781    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183784    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183786    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183789    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183791    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183794    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183797    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183799    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183802    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183804    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.302472 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183807    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183809    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183812    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183814    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183818    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183821    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183825    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183828    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183837    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183840    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183844    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.183848    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.183855    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184000    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:16:01.303729 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184005    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184009    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184013    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184016    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184019    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184022    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184025    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184028    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184030    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184033    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184035    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184038    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184040    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184043    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184045    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184048    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184050    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184053    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184055    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:16:01.304918 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184058    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184060    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184063    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184066    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184069    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184072    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184074    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184077    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184085    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184087    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184090    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184093    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184097    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184100    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184102    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184104    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184107    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184110    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184112    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184115    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:16:01.306131 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184117    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184120    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184123    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184125    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184128    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184130    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184133    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184137    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184141    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184144    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184146    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184149    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184151    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184154    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184156    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184160    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184163    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184165    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184168    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:16:01.306986 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184170    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184173    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184181    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184184    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184186    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184190    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184192    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184195    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184198    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184200    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184203    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184205    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184208    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184210    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184213    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184215    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184218    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184220    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184223    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:16:01.308610 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184226    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184230    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184233    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184235    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184238    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184241    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184244    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184247    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184249    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184253    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184256    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184259    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184262    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184264    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184267    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184270    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184283    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184286    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184289    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184292    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:16:01.309373 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:01.184295    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.184300    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.184446    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.191102    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.193114    2562 server.go:1019] "Starting client certificate rotation"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.193216    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.193254    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.196469    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.198506    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.206500    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.210852    2562 log.go:25] "Validated CRI v1 image API"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.211754    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 18:16:01.311910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.215196    2562 fs.go:135] Filesystem UUIDs: map[3a76e9da-9a8f-422d-8718-2f40df573c08:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b99819df-cd05-443b-a017-3fd796535965:/dev/nvme0n1p3]
Jul 23 18:16:01.312300 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.215211    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.220747    2562 manager.go:216] Machine: {Timestamp:2026-07-23 18:16:01.220119323 +0000 UTC m=+0.313764730 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100957 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26d0021b043332d421c96140d5a420 SystemUUID:ec26d002-1b04-3332-d421-c96140d5a420 BootID:bd2b7a28-72d5-4640-8010-d32fb7c6bf0c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1e:b4:f2:f5:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1e:b4:f2:f5:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:99:9d:2c:c7:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.220847    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.220927    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.224380    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.224413    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.225151    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.225160    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 18:16:01.313525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.225169    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.225836    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.225986    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.227889    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233445    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233584    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233618    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233634    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233645    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233655    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.233668    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.234129    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.234154    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.237755    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.241789    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.241817    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243175    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243191    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243199    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243205    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243214    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243220    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243228    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243234    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243241    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243246    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243255    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.243262    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.244057    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.244065    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.246896    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.247005    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.247068    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.247712    2562 server.go:1268] "Started kubelet"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.247800    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.247790    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.247888    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.250318    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.250457    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 18:16:01.313908 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.254925    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.254074    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-146.ec2.internal.18c4fdf0636de7cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-146.ec2.internal,UID:ip-10-0-137-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-146.ec2.internal,},FirstTimestamp:2026-07-23 18:16:01.247684555 +0000 UTC m=+0.341329963,LastTimestamp:2026-07-23 18:16:01.247684555 +0000 UTC m=+0.341329963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-146.ec2.internal,}"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260027    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260030    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.260165    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260783    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260820    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260835    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260916    2562 factory.go:55] Registering systemd factory
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260935    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260973    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.260985    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.261175    2562 factory.go:153] Registering CRI-O factory
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.261192    2562 factory.go:223] Registration of the crio container factory successfully
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.261253    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.261279    2562 factory.go:103] Registering Raw factory
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.261297    2562 manager.go:1196] Started watching for new ooms in manager
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.262346    2562 manager.go:349] Starting recovery of all containers
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.263734    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.263761    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.272680    2562 manager.go:354] Recovery completed
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.272677    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-thnqx"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.280163    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.280783    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-thnqx"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.282469    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.282526    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.282536    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.286765    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.286776    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.286777    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.286862    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.287655    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.315102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.287685    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.316315 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.287701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.316315 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.289225    2562 policy_none.go:49] "None policy: Start"
Jul 23 18:16:01.316315 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.289240    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 18:16:01.316315 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.289252    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 18:16:01.316315 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.291244    2562 policy_none.go:47] "Start"
Jul 23 18:16:01.431429 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.360618    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.460917    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.469910    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-146.ec2.internal\" not found" node="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531191    2562 manager.go:337] "Starting Device Plugin manager"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.531240    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531254    2562 server.go:87] "Starting device plugin registration server"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531608    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531621    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531723    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531805    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.531815    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.532384    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.532638    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.566759    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.568141    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.568181    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.568207    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.568243    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.570902    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.631986    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.633166    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.633194    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.633205    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.633230    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.643282    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.651660 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.643304    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-146.ec2.internal\": node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.667810    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.668798    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"]
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.668861    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.669759    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.669785    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.669796    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.672515    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.672575    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.673087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.672600    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673230    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673251    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673274    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673283    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673256    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.673339    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.675406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.676393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.675429    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:16:01.676843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.676466    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:16:01.676843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.676505    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:16:01.676843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.676519    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:16:01.809992 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.763621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.809992 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.763650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.809992 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.763667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4579c837d06b9a85c3e22429bd334f55-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"4579c837d06b9a85c3e22429bd334f55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.809992 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.768698    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4579c837d06b9a85c3e22429bd334f55-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"4579c837d06b9a85c3e22429bd334f55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5da9b8002d42ae8c17867a5555d3abdb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal\" (UID: \"5da9b8002d42ae8c17867a5555d3abdb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:01.864319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4579c837d06b9a85c3e22429bd334f55-config\") pod \"kube-apiserver-proxy-ip-10-0-137-146.ec2.internal\" (UID: \"4579c837d06b9a85c3e22429bd334f55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:01.915667 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.869237    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.026695 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:01.969779    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.055497 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.055455    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-146.ec2.internal\" not found" node="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.058977 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.058960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.059955 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.059937    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-146.ec2.internal\" not found" node="ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.062662 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.062647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.070368 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.070342    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.072124 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.072103    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:02.171083 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.170989    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.192172 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.192143    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 18:16:02.192653 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.192329    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:16:02.192653 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.192341    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:16:02.262805 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.262765    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:02.271800 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.271775    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.290640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.290596    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:11:01 +0000 UTC" deadline="2028-03-02 02:45:52.486512477 +0000 UTC"
Jul 23 18:16:02.290640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.290636    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14096h29m50.195879566s"
Jul 23 18:16:02.372939 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.372904    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.473901 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.473823    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.574170 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:02.574140    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-146.ec2.internal\" not found"
Jul 23 18:16:02.611128 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.611107    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:02.663221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.663178    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.677866 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.677840    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:16:02.678911 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.678893    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal"
Jul 23 18:16:02.686235 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:02.686213    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:16:03.024372 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.024338    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4579c837d06b9a85c3e22429bd334f55.slice/crio-b2263bb93c8ac5b5e4b0e4d0265388a25323361eacb133f39ee25491dde49a19 WatchSource:0}: Error finding container b2263bb93c8ac5b5e4b0e4d0265388a25323361eacb133f39ee25491dde49a19: Status 404 returned error can't find the container with id b2263bb93c8ac5b5e4b0e4d0265388a25323361eacb133f39ee25491dde49a19
Jul 23 18:16:03.024801 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.024775    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da9b8002d42ae8c17867a5555d3abdb.slice/crio-8b247c73f0935ed41e1264963f72998551c841bb09bce8f2b54253f9a6b37b3d WatchSource:0}: Error finding container 8b247c73f0935ed41e1264963f72998551c841bb09bce8f2b54253f9a6b37b3d: Status 404 returned error can't find the container with id 8b247c73f0935ed41e1264963f72998551c841bb09bce8f2b54253f9a6b37b3d
Jul 23 18:16:03.029520 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.029503    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:16:03.237418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.237322    2562 apiserver.go:52] "Watching apiserver"
Jul 23 18:16:03.247719 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.247689    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 18:16:03.248072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.248049    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8t2fg","kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal","openshift-dns/node-resolver-nmcxl","openshift-image-registry/node-ca-gs7xj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal","openshift-multus/multus-additional-cni-plugins-5x9hn","openshift-network-operator/iptables-alerter-mnjhr","openshift-ovn-kubernetes/ovnkube-node-rtxvw","kube-system/konnectivity-agent-8zkdd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl","openshift-cluster-node-tuning-operator/tuned-sjdh6","openshift-multus/multus-mcfm6","openshift-multus/network-metrics-daemon-vwhbl","openshift-network-diagnostics/network-check-target-hvbbs"]
Jul 23 18:16:03.252097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.252078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.255246 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.255222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.257065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.256324    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.257065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.256328    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 18:16:03.257065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.256671    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hspk7\""
Jul 23 18:16:03.257065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.256941    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.259067 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.259047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.259670 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.259644    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.259772 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.259723    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6vgps\""
Jul 23 18:16:03.259911 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.259890    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.260473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.260453    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 18:16:03.261397 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.261305    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.261832 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.261815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4lsqb\""
Jul 23 18:16:03.262406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.262362    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.262406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.262362    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.263637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.263618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:03.263721 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.263675    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:03.265900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.265875    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.268167 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.268144    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.268266 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.268168    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 18:16:03.268320 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.268285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.269493 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.269462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lv6zs\""
Jul 23 18:16:03.269844 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.269803    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.269943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.269855    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.269943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.269909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 18:16:03.270137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.270123    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 18:16:03.270202 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.270189    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xp5hv\""
Jul 23 18:16:03.270263 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.270243    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 18:16:03.270311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.270282    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.270764 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.270746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.270865 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.270803    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:03.271717 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.271702    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 18:16:03.271807 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.271790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k72gt\""
Jul 23 18:16:03.271954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.271938    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 18:16:03.272650 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272732 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-var-lib-kubelet\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272732 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272675    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-tmp\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272732 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9hj\" (UniqueName: \"kubernetes.io/projected/97fb56ac-194c-4bc6-b38f-382f255e7961-kube-api-access-5b9hj\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysconfig\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-kubernetes\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-run\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-tuned\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97fb56ac-194c-4bc6-b38f-382f255e7961-host\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97fb56ac-194c-4bc6-b38f-382f255e7961-serviceca\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e7d888-7ba9-4cd0-abf3-a31e791e4467-host-slash\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq42d\" (UniqueName: \"kubernetes.io/projected/10e7d888-7ba9-4cd0-abf3-a31e791e4467-kube-api-access-dq42d\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.272895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-modprobe-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-conf\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-systemd\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.272971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-hosts-file\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkqf\" (UniqueName: \"kubernetes.io/projected/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-kube-api-access-6jkqf\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e7d888-7ba9-4cd0-abf3-a31e791e4467-iptables-alerter-script\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-sys\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-lib-modules\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-host\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbpvx\" (UniqueName: \"kubernetes.io/projected/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-kube-api-access-vbpvx\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.273311 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-tmp-dir\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.273790 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.273319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.275804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.275787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.278113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278091    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.278250 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278191    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 18:16:03.278250 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278196    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.278398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sr27z\""
Jul 23 18:16:03.278398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278375    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 18:16:03.278539 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278375    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 18:16:03.278539 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278471    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.278691 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.278542    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:03.278806 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.278792    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 18:16:03.279097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.279078    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 18:16:03.279615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.279593    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 18:16:03.280030 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.280016    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4g4k\""
Jul 23 18:16:03.280342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.280316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 18:16:03.280900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.280886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.283595 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.283579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s7skp\""
Jul 23 18:16:03.283865 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.283852    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 18:16:03.291154 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.291126    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:16:03.326263 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.326238    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-skmjf"
Jul 23 18:16:03.340963 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.340937    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-skmjf"
Jul 23 18:16:03.361892 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.361860    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 18:16:03.373450 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e7d888-7ba9-4cd0-abf3-a31e791e4467-iptables-alerter-script\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-lib-modules\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-host\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-tmp-dir\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-config\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xg7\" (UniqueName: \"kubernetes.io/projected/b115701b-1c4b-4657-a263-fd9d8c89cd0f-kube-api-access-77xg7\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-host\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.373617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-multus-certs\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373639    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-lib-modules\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-slash\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-etc-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovn-node-metrics-cert\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-sys-fs\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-bin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.373900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-run\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-tuned\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97fb56ac-194c-4bc6-b38f-382f255e7961-host\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.373998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-tmp-dir\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97fb56ac-194c-4bc6-b38f-382f255e7961-serviceca\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-netns\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/97fb56ac-194c-4bc6-b38f-382f255e7961-host\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374047    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-run\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374134    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10e7d888-7ba9-4cd0-abf3-a31e791e4467-iptables-alerter-script\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cni-binary-copy\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e7d888-7ba9-4cd0-abf3-a31e791e4467-host-slash\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-hosts-file\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkqf\" (UniqueName: \"kubernetes.io/projected/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-kube-api-access-6jkqf\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.374261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374229    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-systemd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10e7d888-7ba9-4cd0-abf3-a31e791e4467-host-slash\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374280    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-hosts-file\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-kubelet-config\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-netns\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbpvx\" (UniqueName: \"kubernetes.io/projected/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-kube-api-access-vbpvx\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6cac72e-adc0-40a5-a935-b77cacbd790e-agent-certs\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-hostroot\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45jzp\" (UniqueName: \"kubernetes.io/projected/e27641c4-1d54-415b-a312-41c8364255ab-kube-api-access-45jzp\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/97fb56ac-194c-4bc6-b38f-382f255e7961-serviceca\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-var-lib-kubelet\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.374933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-tmp\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9hj\" (UniqueName: \"kubernetes.io/projected/97fb56ac-194c-4bc6-b38f-382f255e7961-kube-api-access-5b9hj\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-var-lib-kubelet\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-dbus\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-os-release\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysconfig\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374647    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysconfig\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-node-log\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-bin\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-env-overrides\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8pg\" (UniqueName: \"kubernetes.io/projected/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kube-api-access-wp8pg\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq42d\" (UniqueName: \"kubernetes.io/projected/10e7d888-7ba9-4cd0-abf3-a31e791e4467-kube-api-access-dq42d\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.375619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-modprobe-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-systemd\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-modprobe-d\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-daemon-config\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.374991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-sys\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-systemd\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-script-lib\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-registration-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-sys\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-device-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cnibin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-kubelet\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.376097 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-socket-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-kubernetes\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-kubelet\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-systemd-units\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-kubernetes\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-ovn\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-os-release\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-conf\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-socket-dir-parent\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-k8s-cni-cncf-io\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375594    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-log-socket\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-sysctl-conf\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-system-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-conf-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9k86\" (UniqueName: \"kubernetes.io/projected/d9b68c6c-016a-49eb-a4be-9d650b000ddc-kube-api-access-m9k86\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-system-cni-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp8hj\" (UniqueName: \"kubernetes.io/projected/04e40790-7de4-400b-9d8b-3f302877e2b5-kube-api-access-qp8hj\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-netd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-etc-kubernetes\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6cac72e-adc0-40a5-a935-b77cacbd790e-konnectivity-ca\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-multus\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-var-lib-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.376983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.375898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-cnibin\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.377854 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.377834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-tmp\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.377904 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.377888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-etc-tuned\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.384616 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.384595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkqf\" (UniqueName: \"kubernetes.io/projected/ade9c15f-dc6f-4b81-a470-5eec01f93f2f-kube-api-access-6jkqf\") pod \"node-resolver-nmcxl\" (UID: \"ade9c15f-dc6f-4b81-a470-5eec01f93f2f\") " pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.388897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.388871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9hj\" (UniqueName: \"kubernetes.io/projected/97fb56ac-194c-4bc6-b38f-382f255e7961-kube-api-access-5b9hj\") pod \"node-ca-gs7xj\" (UID: \"97fb56ac-194c-4bc6-b38f-382f255e7961\") " pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.390752 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.390728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbpvx\" (UniqueName: \"kubernetes.io/projected/39fa1983-5a6c-4dfe-b83d-cf27169e3c03-kube-api-access-vbpvx\") pod \"tuned-sjdh6\" (UID: \"39fa1983-5a6c-4dfe-b83d-cf27169e3c03\") " pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.390870 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.390855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq42d\" (UniqueName: \"kubernetes.io/projected/10e7d888-7ba9-4cd0-abf3-a31e791e4467-kube-api-access-dq42d\") pod \"iptables-alerter-mnjhr\" (UID: \"10e7d888-7ba9-4cd0-abf3-a31e791e4467\") " pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.476574 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-netns\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.476574 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cni-binary-copy\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-systemd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-kubelet-config\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-systemd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-netns\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-netns\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.476781    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-kubelet-config\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.476834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6cac72e-adc0-40a5-a935-b77cacbd790e-agent-certs\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-hostroot\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45jzp\" (UniqueName: \"kubernetes.io/projected/e27641c4-1d54-415b-a312-41c8364255ab-kube-api-access-45jzp\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-dbus\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-os-release\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-node-log\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-bin\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-env-overrides\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8pg\" (UniqueName: \"kubernetes.io/projected/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kube-api-access-wp8pg\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-daemon-config\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477135    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/83f7da9e-35c2-4854-a811-ebcce303e908-dbus\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.477460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.476956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-hostroot\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.477176    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:03.977151793 +0000 UTC m=+3.070797203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-bin\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-etc-selinux\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477312    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-node-log\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-script-lib\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-registration-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cni-binary-copy\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-device-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cnibin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-device-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-kubelet\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-registration-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-socket-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.477567    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-cnibin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.477628    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:03.977612629 +0000 UTC m=+3.071258025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477644    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-kubelet\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-kubelet\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-kubelet\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-systemd-units\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-ovn\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-run-netns\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.478889 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-systemd-units\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-ovn\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-os-release\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-socket-dir\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-socket-dir-parent\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-k8s-cni-cncf-io\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-socket-dir-parent\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-log-socket\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477944    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-system-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.479637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.477990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-k8s-cni-cncf-io\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-system-cni-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-log-socket\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-run-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-conf-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9k86\" (UniqueName: \"kubernetes.io/projected/d9b68c6c-016a-49eb-a4be-9d650b000ddc-kube-api-access-m9k86\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-system-cni-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp8hj\" (UniqueName: \"kubernetes.io/projected/04e40790-7de4-400b-9d8b-3f302877e2b5-kube-api-access-qp8hj\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-netd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478226    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-os-release\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-etc-kubernetes\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-system-cni-dir\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6cac72e-adc0-40a5-a935-b77cacbd790e-konnectivity-ca\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.480333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-conf-dir\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-multus\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-var-lib-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-cnibin\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-script-lib\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-config\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xg7\" (UniqueName: \"kubernetes.io/projected/b115701b-1c4b-4657-a263-fd9d8c89cd0f-kube-api-access-77xg7\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-multus-certs\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-slash\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-multus\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-etc-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovn-node-metrics-cert\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478629    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-run-multus-certs\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-sys-fs\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-bin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478862    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-os-release\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-cni-netd\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.478992    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c6cac72e-adc0-40a5-a935-b77cacbd790e-konnectivity-ca\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.479018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-host-var-lib-cni-bin\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.479075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-sys-fs\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.479076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d9b68c6c-016a-49eb-a4be-9d650b000ddc-multus-daemon-config\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.479080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-var-lib-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.479897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04e40790-7de4-400b-9d8b-3f302877e2b5-cnibin\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d9b68c6c-016a-49eb-a4be-9d650b000ddc-etc-kubernetes\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.481696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-env-overrides\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.482416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovnkube-config\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.482416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-host-slash\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.482416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480330    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b115701b-1c4b-4657-a263-fd9d8c89cd0f-etc-openvswitch\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.482416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c6cac72e-adc0-40a5-a935-b77cacbd790e-agent-certs\") pod \"konnectivity-agent-8zkdd\" (UID: \"c6cac72e-adc0-40a5-a935-b77cacbd790e\") " pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.482416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.480691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04e40790-7de4-400b-9d8b-3f302877e2b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.484474 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.484446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b115701b-1c4b-4657-a263-fd9d8c89cd0f-ovn-node-metrics-cert\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.489747 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.489654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8pg\" (UniqueName: \"kubernetes.io/projected/bb1c3c26-7adc-40f6-b75c-f6766cd3afbc-kube-api-access-wp8pg\") pod \"aws-ebs-csi-driver-node-4pmzl\" (UID: \"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.493379 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.493346    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:03.493379 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.493374    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:03.493554 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.493389    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:03.493554 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.493453    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:03.99343417 +0000 UTC m=+3.087079582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:03.496404 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.496383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp8hj\" (UniqueName: \"kubernetes.io/projected/04e40790-7de4-400b-9d8b-3f302877e2b5-kube-api-access-qp8hj\") pod \"multus-additional-cni-plugins-5x9hn\" (UID: \"04e40790-7de4-400b-9d8b-3f302877e2b5\") " pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.496523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.496423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9k86\" (UniqueName: \"kubernetes.io/projected/d9b68c6c-016a-49eb-a4be-9d650b000ddc-kube-api-access-m9k86\") pod \"multus-mcfm6\" (UID: \"d9b68c6c-016a-49eb-a4be-9d650b000ddc\") " pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.497912 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.497893    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45jzp\" (UniqueName: \"kubernetes.io/projected/e27641c4-1d54-415b-a312-41c8364255ab-kube-api-access-45jzp\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.499929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.499908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xg7\" (UniqueName: \"kubernetes.io/projected/b115701b-1c4b-4657-a263-fd9d8c89cd0f-kube-api-access-77xg7\") pod \"ovnkube-node-rtxvw\" (UID: \"b115701b-1c4b-4657-a263-fd9d8c89cd0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.565912 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.565874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnjhr"
Jul 23 18:16:03.570287 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.570254    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjdh6"
Jul 23 18:16:03.573687 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.573593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"5da9b8002d42ae8c17867a5555d3abdb","Type":"ContainerStarted","Data":"8b247c73f0935ed41e1264963f72998551c841bb09bce8f2b54253f9a6b37b3d"}
Jul 23 18:16:03.574867 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.574844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" event={"ID":"4579c837d06b9a85c3e22429bd334f55","Type":"ContainerStarted","Data":"b2263bb93c8ac5b5e4b0e4d0265388a25323361eacb133f39ee25491dde49a19"}
Jul 23 18:16:03.579209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.579186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nmcxl"
Jul 23 18:16:03.579797 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.579770    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10e7d888_7ba9_4cd0_abf3_a31e791e4467.slice/crio-ad2289cd8fbca9a5f6ef46c62980a80304116ed7bbf318edbcc5249fae0ab47e WatchSource:0}: Error finding container ad2289cd8fbca9a5f6ef46c62980a80304116ed7bbf318edbcc5249fae0ab47e: Status 404 returned error can't find the container with id ad2289cd8fbca9a5f6ef46c62980a80304116ed7bbf318edbcc5249fae0ab47e
Jul 23 18:16:03.580204 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.580169    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39fa1983_5a6c_4dfe_b83d_cf27169e3c03.slice/crio-3ee12ebe310c45c425101462945a3c4b4e738caa161df7defaef5eece9fe174e WatchSource:0}: Error finding container 3ee12ebe310c45c425101462945a3c4b4e738caa161df7defaef5eece9fe174e: Status 404 returned error can't find the container with id 3ee12ebe310c45c425101462945a3c4b4e738caa161df7defaef5eece9fe174e
Jul 23 18:16:03.585013 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.584368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gs7xj"
Jul 23 18:16:03.589909 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.589882    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade9c15f_dc6f_4b81_a470_5eec01f93f2f.slice/crio-ddfc7136c00da7d9630598e85e992d6597f13114729306316b65e28b64f5ad0c WatchSource:0}: Error finding container ddfc7136c00da7d9630598e85e992d6597f13114729306316b65e28b64f5ad0c: Status 404 returned error can't find the container with id ddfc7136c00da7d9630598e85e992d6597f13114729306316b65e28b64f5ad0c
Jul 23 18:16:03.590453 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.590435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5x9hn"
Jul 23 18:16:03.595538 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.595511    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97fb56ac_194c_4bc6_b38f_382f255e7961.slice/crio-490ea05160a75f759cc9afc5bb9473cc38cb7f4d01b0108e019b3595c8ab475d WatchSource:0}: Error finding container 490ea05160a75f759cc9afc5bb9473cc38cb7f4d01b0108e019b3595c8ab475d: Status 404 returned error can't find the container with id 490ea05160a75f759cc9afc5bb9473cc38cb7f4d01b0108e019b3595c8ab475d
Jul 23 18:16:03.596579 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.596534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:03.601299 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.601270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e40790_7de4_400b_9d8b_3f302877e2b5.slice/crio-54bd00ab37d21b0153821cc39fff95067a9a1ac3252b59fcb1dc108e968645d2 WatchSource:0}: Error finding container 54bd00ab37d21b0153821cc39fff95067a9a1ac3252b59fcb1dc108e968645d2: Status 404 returned error can't find the container with id 54bd00ab37d21b0153821cc39fff95067a9a1ac3252b59fcb1dc108e968645d2
Jul 23 18:16:03.605354 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.605161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:03.610030 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.610004    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6cac72e_adc0_40a5_a935_b77cacbd790e.slice/crio-7405cef9733007c837acaee6b33ca5d275068b418872498febf0a91908d7423e WatchSource:0}: Error finding container 7405cef9733007c837acaee6b33ca5d275068b418872498febf0a91908d7423e: Status 404 returned error can't find the container with id 7405cef9733007c837acaee6b33ca5d275068b418872498febf0a91908d7423e
Jul 23 18:16:03.610137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.610047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl"
Jul 23 18:16:03.615419 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.615393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mcfm6"
Jul 23 18:16:03.617627 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.617592    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb115701b_1c4b_4657_a263_fd9d8c89cd0f.slice/crio-9167078bdffbea7d5a0754b2ecbc3c186c4e0c85d20da616953c97c0ae01004c WatchSource:0}: Error finding container 9167078bdffbea7d5a0754b2ecbc3c186c4e0c85d20da616953c97c0ae01004c: Status 404 returned error can't find the container with id 9167078bdffbea7d5a0754b2ecbc3c186c4e0c85d20da616953c97c0ae01004c
Jul 23 18:16:03.623434 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.623407    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1c3c26_7adc_40f6_b75c_f6766cd3afbc.slice/crio-843ba120b54c88a105e8d998553ce875697b509d3467b28bd18e8622397f2003 WatchSource:0}: Error finding container 843ba120b54c88a105e8d998553ce875697b509d3467b28bd18e8622397f2003: Status 404 returned error can't find the container with id 843ba120b54c88a105e8d998553ce875697b509d3467b28bd18e8622397f2003
Jul 23 18:16:03.626653 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:03.626627    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b68c6c_016a_49eb_a4be_9d650b000ddc.slice/crio-c51f610c1213145f9c68964b5b1515030166d4c17c2c6119b63133839f65d68c WatchSource:0}: Error finding container c51f610c1213145f9c68964b5b1515030166d4c17c2c6119b63133839f65d68c: Status 404 returned error can't find the container with id c51f610c1213145f9c68964b5b1515030166d4c17c2c6119b63133839f65d68c
Jul 23 18:16:03.732813 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.732777    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:03.983102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.983056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:03.983303 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:03.983134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:03.983303 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.983191    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:03.983303 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.983221    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:03.983303 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.983264    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:04.983245105 +0000 UTC m=+4.076890519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:03.983303 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:03.983285    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:04.983275148 +0000 UTC m=+4.076920546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:04.084292 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.084218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:04.084457 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.084443    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:04.084636 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.084468    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:04.084636 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.084483    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:04.084636 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.084572    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:05.084550509 +0000 UTC m=+4.178195925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:04.344632 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.344599    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:11:03 +0000 UTC" deadline="2028-03-12 14:35:20.237966718 +0000 UTC"
Jul 23 18:16:04.344632 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.344629    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14348h19m15.893340818s"
Jul 23 18:16:04.569386 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.568737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:04.569386 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.568776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:04.569386 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.568888    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:04.569386 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.569018    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:04.580705 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.580658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjdh6" event={"ID":"39fa1983-5a6c-4dfe-b83d-cf27169e3c03","Type":"ContainerStarted","Data":"3ee12ebe310c45c425101462945a3c4b4e738caa161df7defaef5eece9fe174e"}
Jul 23 18:16:04.584096 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.584034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl" event={"ID":"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc","Type":"ContainerStarted","Data":"843ba120b54c88a105e8d998553ce875697b509d3467b28bd18e8622397f2003"}
Jul 23 18:16:04.587597 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.587470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"9167078bdffbea7d5a0754b2ecbc3c186c4e0c85d20da616953c97c0ae01004c"}
Jul 23 18:16:04.589624 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.589565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zkdd" event={"ID":"c6cac72e-adc0-40a5-a935-b77cacbd790e","Type":"ContainerStarted","Data":"7405cef9733007c837acaee6b33ca5d275068b418872498febf0a91908d7423e"}
Jul 23 18:16:04.592275 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.592210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnjhr" event={"ID":"10e7d888-7ba9-4cd0-abf3-a31e791e4467","Type":"ContainerStarted","Data":"ad2289cd8fbca9a5f6ef46c62980a80304116ed7bbf318edbcc5249fae0ab47e"}
Jul 23 18:16:04.595221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.595170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcfm6" event={"ID":"d9b68c6c-016a-49eb-a4be-9d650b000ddc","Type":"ContainerStarted","Data":"c51f610c1213145f9c68964b5b1515030166d4c17c2c6119b63133839f65d68c"}
Jul 23 18:16:04.596760 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.596731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerStarted","Data":"54bd00ab37d21b0153821cc39fff95067a9a1ac3252b59fcb1dc108e968645d2"}
Jul 23 18:16:04.598427 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.598398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs7xj" event={"ID":"97fb56ac-194c-4bc6-b38f-382f255e7961","Type":"ContainerStarted","Data":"490ea05160a75f759cc9afc5bb9473cc38cb7f4d01b0108e019b3595c8ab475d"}
Jul 23 18:16:04.610846 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.609580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmcxl" event={"ID":"ade9c15f-dc6f-4b81-a470-5eec01f93f2f","Type":"ContainerStarted","Data":"ddfc7136c00da7d9630598e85e992d6597f13114729306316b65e28b64f5ad0c"}
Jul 23 18:16:04.991931 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.991833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:04.992121 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:04.991975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:04.992185 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.992133    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:04.992263 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.992223    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:06.992203108 +0000 UTC m=+6.085848520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:04.992730 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.992707    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:04.992844 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:04.992771    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:06.992753286 +0000 UTC m=+6.086398690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:05.093496 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.093205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:05.093727 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:05.093699    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:05.093727 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:05.093721    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:05.093863 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:05.093735    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:05.093863 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:05.093809    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:07.09378014 +0000 UTC m=+6.187425541 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:05.167312 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.167271    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:16:05.345794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.345724    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:11:03 +0000 UTC" deadline="2028-04-28 18:17:08.696155186 +0000 UTC"
Jul 23 18:16:05.345794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.345792    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15480h1m3.350367945s"
Jul 23 18:16:05.571457 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.571421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:05.571646 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:05.571572    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:05.622226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:05.621600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"5da9b8002d42ae8c17867a5555d3abdb","Type":"ContainerStarted","Data":"dcacf6cfe7c79912d5338f0fc27256a3a2628df92e10490e47b482a5388cb970"}
Jul 23 18:16:06.568647 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:06.568609    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:06.569151 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:06.568662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:06.569151 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:06.568786    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:06.569151 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:06.568924    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:07.009615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.009564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:07.009817 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.009658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:07.009817 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.009777    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:07.009980 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.009827    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:07.009980 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.009858    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:11.009834995 +0000 UTC m=+10.103480405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:07.009980 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.009918    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:11.009900699 +0000 UTC m=+10.103546111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:07.110673 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.110632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:07.110957 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.110936    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:07.111034 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.110967    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:07.111034 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.110982    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:07.111157 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.111080    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:11.111057325 +0000 UTC m=+10.204702748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:07.571222 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.571182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:07.571748 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:07.571337    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:07.633339 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.632616    2562 generic.go:356] "Generic (PLEG): container finished" podID="5da9b8002d42ae8c17867a5555d3abdb" containerID="dcacf6cfe7c79912d5338f0fc27256a3a2628df92e10490e47b482a5388cb970" exitCode=0
Jul 23 18:16:07.633339 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:07.632677    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"5da9b8002d42ae8c17867a5555d3abdb","Type":"ContainerDied","Data":"dcacf6cfe7c79912d5338f0fc27256a3a2628df92e10490e47b482a5388cb970"}
Jul 23 18:16:08.568978 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:08.568923    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:08.569181 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:08.569096    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:08.569610 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:08.569585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:08.569728 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:08.569699    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:09.569336 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:09.569301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:09.569867 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:09.569440    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:10.569207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:10.569166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:10.569207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:10.569205    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:10.569782 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:10.569300    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:10.569782 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:10.569394    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:11.046798 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:11.046758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:11.046991 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:11.046832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:11.046991 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.046980    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:11.047100 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.047046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:19.047025521 +0000 UTC m=+18.140670936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:11.047570 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.047460    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:11.047570 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.047536    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:19.047519922 +0000 UTC m=+18.141165330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:11.147818 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:11.147748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:11.148000 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.147976    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:11.148000 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.147998    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:11.148125 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.148011    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:11.148125 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.148069    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:19.148050877 +0000 UTC m=+18.241696276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:11.570267 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:11.569786    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:11.570267 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:11.569916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:12.569072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:12.569025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:12.569072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:12.569072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:12.569285 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:12.569194    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:12.569459 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:12.569437    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:13.568740 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:13.568702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:13.569201 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:13.568838    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:14.569309 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:14.569270    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:14.569794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:14.569273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:14.569794 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:14.569422    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:14.569794 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:14.569454    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:15.568779 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:15.568746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:15.569012 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:15.568876    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:16.568617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:16.568467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:16.568617 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:16.568535    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:16.569165 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:16.568701    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:16.569165 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:16.568760    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:17.568675 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:17.568629    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:17.569043 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:17.568765    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:18.568896 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:18.568855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:18.568896 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:18.568887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:18.569363 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:18.568984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:18.569363 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:18.569106    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:19.107607 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:19.107565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:19.107788 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:19.107620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:19.107788 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.107711    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:19.107788 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.107739    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:19.107945 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.107839    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:35.107800689 +0000 UTC m=+34.201446092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:19.107945 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.107860    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:16:35.107852371 +0000 UTC m=+34.201497771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:19.208248 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:19.208161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:19.208398 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.208304    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:19.208398 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.208329    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:19.208398 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.208341    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:19.208525 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.208404    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:16:35.208386228 +0000 UTC m=+34.302031646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:19.569113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:19.569071    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:19.569599 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:19.569217    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:20.568912 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:20.568877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:20.569115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:20.568877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:20.569115 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:20.569014    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:20.569556 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:20.569118    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:21.569203 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:21.569166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:21.569697 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:21.569275    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:22.568509 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:22.568421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:22.568509 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:22.568445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:22.568710 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:22.568573    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:22.568710 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:22.568668    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:23.569224 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.569197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:23.569713 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:23.569318    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:23.665628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.665364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl" event={"ID":"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc","Type":"ContainerStarted","Data":"9298de66c8af5f456544f2395fae5e82d773c3d593e36c6e117b1ec8c0388829"}
Jul 23 18:16:23.667845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.667811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"cdbbb69bbe7e79671f6f3774cf07634c09fc2989d095d1886c23a11916d3acdf"}
Jul 23 18:16:23.670274 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.670224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8zkdd" event={"ID":"c6cac72e-adc0-40a5-a935-b77cacbd790e","Type":"ContainerStarted","Data":"7aa752771c2eb2276de440ee83d49da4a5c36bcbe6663fa61e9adc6761e8a320"}
Jul 23 18:16:23.672769 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.672743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" event={"ID":"5da9b8002d42ae8c17867a5555d3abdb","Type":"ContainerStarted","Data":"70b173e1e74f8d697858c43d3bcb7088e99fe3dd26cce46f9bc567b8746ab7d0"}
Jul 23 18:16:23.675953 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.675660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" event={"ID":"4579c837d06b9a85c3e22429bd334f55","Type":"ContainerStarted","Data":"9b0aa06ed63869f5864c962f583272414b5e373e89a3f59e1f3cefbda7d28692"}
Jul 23 18:16:23.679241 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.679180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mcfm6" event={"ID":"d9b68c6c-016a-49eb-a4be-9d650b000ddc","Type":"ContainerStarted","Data":"4c038618e3f22aab648bd80229286d73af38c0b627cc17252c87e7b08453c07e"}
Jul 23 18:16:23.681408 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.681362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerStarted","Data":"00f7871893a8af56b475a52a223da1727135cd1ca6be41a3abfd215382e39e52"}
Jul 23 18:16:23.683911 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.683855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gs7xj" event={"ID":"97fb56ac-194c-4bc6-b38f-382f255e7961","Type":"ContainerStarted","Data":"c80cce37133e966d0cb19f3f25008dd3fe887b8c85d0321800650da03c674257"}
Jul 23 18:16:23.685137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.685116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nmcxl" event={"ID":"ade9c15f-dc6f-4b81-a470-5eec01f93f2f","Type":"ContainerStarted","Data":"be3617e44998fa77f4a8fbf41f9d899830ba62f87cfc3f6d355f1ba8a93b3ba9"}
Jul 23 18:16:23.686303 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.686284    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjdh6" event={"ID":"39fa1983-5a6c-4dfe-b83d-cf27169e3c03","Type":"ContainerStarted","Data":"435bb30d752825c8a034e9125f50375e34fbaf0c1aaa96d74587279f7d3a7d01"}
Jul 23 18:16:23.703145 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.703096    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8zkdd" podStartSLOduration=10.731543135999999 podStartE2EDuration="21.703080155s" totalImagesPullingTime="10.971537019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.687853153 +0000 UTC m=+22.781498571" watchObservedRunningTime="2026-07-23 18:16:23.703080155 +0000 UTC m=+22.796725575"
Jul 23 18:16:23.718141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.718099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-146.ec2.internal" podStartSLOduration=20.718083508 podStartE2EDuration="20.718083508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.702688184 +0000 UTC m=+22.796333599" watchObservedRunningTime="2026-07-23 18:16:23.718083508 +0000 UTC m=+22.811728925"
Jul 23 18:16:23.718282 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.718194    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gs7xj" podStartSLOduration=1.965750313 podStartE2EDuration="21.718189465s" totalImagesPullingTime="19.752439152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.718173713 +0000 UTC m=+22.811819135" watchObservedRunningTime="2026-07-23 18:16:23.718189465 +0000 UTC m=+22.811834914"
Jul 23 18:16:23.736831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.736788    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mcfm6" podStartSLOduration=1.97633263 podStartE2EDuration="21.736771941s" totalImagesPullingTime="19.760439311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.736588658 +0000 UTC m=+22.830234074" watchObservedRunningTime="2026-07-23 18:16:23.736771941 +0000 UTC m=+22.830417360"
Jul 23 18:16:23.752580 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.752529    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-146.ec2.internal" podStartSLOduration=20.752514894 podStartE2EDuration="20.752514894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.752367127 +0000 UTC m=+22.846012555" watchObservedRunningTime="2026-07-23 18:16:23.752514894 +0000 UTC m=+22.846160311"
Jul 23 18:16:23.796151 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.796099    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sjdh6" podStartSLOduration=2.336909566 podStartE2EDuration="21.796078852s" totalImagesPullingTime="19.459169286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.79574964 +0000 UTC m=+22.889395057" watchObservedRunningTime="2026-07-23 18:16:23.796078852 +0000 UTC m=+22.889724270"
Jul 23 18:16:23.811800 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:23.811743    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nmcxl" podStartSLOduration=6.744530021 podStartE2EDuration="21.811721216s" totalImagesPullingTime="15.067191195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:23.810913637 +0000 UTC m=+22.904559057" watchObservedRunningTime="2026-07-23 18:16:23.811721216 +0000 UTC m=+22.905366635"
Jul 23 18:16:24.568645 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.568608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:24.568918 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:24.568730    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:24.568918 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.568789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:24.569021 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:24.568916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:24.690245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.690210    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="00f7871893a8af56b475a52a223da1727135cd1ca6be41a3abfd215382e39e52" exitCode=0
Jul 23 18:16:24.691042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.690300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"00f7871893a8af56b475a52a223da1727135cd1ca6be41a3abfd215382e39e52"}
Jul 23 18:16:24.694545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.694511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"9ee34fa77818d46b379a3be833d381c3948dd34edcb71471f8c9402d2c0b6366"}
Jul 23 18:16:24.694672 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.694601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"88aa2021700f1e91f44460e5644aa9f9b77036394db19185a88fa83cf9df320b"}
Jul 23 18:16:24.694672 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.694650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"a50d2fc2cc7dd972ac74ced5afd560da21fe9a1f5bad3ad98cb5d356ca9902c2"}
Jul 23 18:16:24.694782 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.694695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"b42a06d520a9f7c5ed0f4072d9982996f9a0e1d7c7bd98df82c63491e8dbdf64"}
Jul 23 18:16:24.694782 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.694744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"5c19188a52e66d6752042e1069d0145fba94619c11f16ec853be153103946c85"}
Jul 23 18:16:24.918373 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:24.918347    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 18:16:25.555254 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.555122    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:16:24.918365331Z","UUID":"1c81d854-1937-4d69-880c-06fe52b774e2","Handler":null,"Name":"","Endpoint":""}
Jul 23 18:16:25.556945 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.556916    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 18:16:25.557089 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.556962    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 18:16:25.568502 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.568467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:25.568632 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:25.568602    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:25.698847 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.698798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl" event={"ID":"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc","Type":"ContainerStarted","Data":"171f3d4485e77006faa91492728d5efc8160128a5355cf04bc61e5107a87fe84"}
Jul 23 18:16:25.700733 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.700696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnjhr" event={"ID":"10e7d888-7ba9-4cd0-abf3-a31e791e4467","Type":"ContainerStarted","Data":"c6fa87d3b6a50f80e780c7c86d1b778e49a50a907c16edd707f76ec9ebbce886"}
Jul 23 18:16:25.716083 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:25.716029    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mnjhr" podStartSLOduration=8.639228864 podStartE2EDuration="23.716006577s" totalImagesPullingTime="15.076777713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:25.715614318 +0000 UTC m=+24.809259735" watchObservedRunningTime="2026-07-23 18:16:25.716006577 +0000 UTC m=+24.809651997"
Jul 23 18:16:26.569255 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:26.569212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:26.569460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:26.569219    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:26.569460 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:26.569334    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:26.569460 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:26.569404    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:26.705804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:26.705758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl" event={"ID":"bb1c3c26-7adc-40f6-b75c-f6766cd3afbc","Type":"ContainerStarted","Data":"84c1459822c687e4e20b6af5b8cf1983de9bd6c425144757f9139ae9f128335b"}
Jul 23 18:16:26.709807 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:26.709770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"4c3a927d74f80c6b0f35e5c2e86832c8bdffc405a5c84c5b70c8fb733aee13c0"}
Jul 23 18:16:26.723940 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:26.723898    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4pmzl" podStartSLOduration=2.745324621 podStartE2EDuration="24.723884196s" totalImagesPullingTime="21.978559575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:26.723409258 +0000 UTC m=+25.817054676" watchObservedRunningTime="2026-07-23 18:16:26.723884196 +0000 UTC m=+25.817529642"
Jul 23 18:16:27.057303 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:27.057272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:27.057974 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:27.057947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:27.569194 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:27.569000    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:27.569379 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:27.569299    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:27.712620 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:27.712588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:27.713095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:27.713078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8zkdd"
Jul 23 18:16:28.569215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:28.569177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:28.569432 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:28.569237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:28.569432 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:28.569309    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:28.569432 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:28.569420    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:29.569687 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.569401    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:29.573822 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:29.573290    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:29.720496 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.720442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" event={"ID":"b115701b-1c4b-4657-a263-fd9d8c89cd0f","Type":"ContainerStarted","Data":"6ccbb657f567d08f51fe230512f43ce479a9cd507dd269b9e5b450da7316fc1c"}
Jul 23 18:16:29.720781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.720751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:29.720907 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.720829    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:29.720907 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.720877    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:29.722543 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.722514    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="1856c8738261387640a4572b0a814da934dc387d9ca8764584e77c1ddcb0d0b9" exitCode=0
Jul 23 18:16:29.722674 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.722601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"1856c8738261387640a4572b0a814da934dc387d9ca8764584e77c1ddcb0d0b9"}
Jul 23 18:16:29.736723 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.736653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:29.736834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.736793    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:16:29.749532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:29.749471    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw" podStartSLOduration=7.80880437 podStartE2EDuration="27.749458319s" totalImagesPullingTime="19.940653949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:29.749359978 +0000 UTC m=+28.843005388" watchObservedRunningTime="2026-07-23 18:16:29.749458319 +0000 UTC m=+28.843103735"
Jul 23 18:16:30.569153 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:30.569113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:30.569406 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:30.569257    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:30.569670 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:30.569649    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:30.569765 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:30.569746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:31.222569 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.222489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t2fg"]
Jul 23 18:16:31.222822 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.222581    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:31.222822 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:31.222667    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:31.225630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.225604    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvbbs"]
Jul 23 18:16:31.225721 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.225696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:31.225812 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:31.225792    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:31.228095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.228074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vwhbl"]
Jul 23 18:16:31.228201 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.228148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:31.228246 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:31.228218    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:31.729342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.729300    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="9697ba5499ae4e1a5a0f1dc92629e8c03b62c2a634389d16c591112f1379d207" exitCode=0
Jul 23 18:16:31.729760 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:31.729382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"9697ba5499ae4e1a5a0f1dc92629e8c03b62c2a634389d16c591112f1379d207"}
Jul 23 18:16:32.568532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:32.568500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:32.568694 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:32.568500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:32.568694 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:32.568608    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:32.568694 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:32.568506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:32.568694 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:32.568677    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:32.568911 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:32.568741    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:33.735674 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:33.735417    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="ff140958e0dd1f84adda1bf04706f9a905f68907c72348d1d17fcd5815b6ba30" exitCode=0
Jul 23 18:16:33.735674 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:33.735507    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"ff140958e0dd1f84adda1bf04706f9a905f68907c72348d1d17fcd5815b6ba30"}
Jul 23 18:16:34.568891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:34.568856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:34.569073 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:34.568946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:34.569073 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:34.568950    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hvbbs" podUID="20917a95-d33a-4f01-8bd6-ba8b3d2c639f"
Jul 23 18:16:34.569073 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:34.568997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:34.569196 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:34.569092    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8t2fg" podUID="83f7da9e-35c2-4854-a811-ebcce303e908"
Jul 23 18:16:34.569196 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:34.569151    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwhbl" podUID="e27641c4-1d54-415b-a312-41c8364255ab"
Jul 23 18:16:35.130049 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:35.130003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:35.130510 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:35.130074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:35.130510 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.130131    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:35.130510 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.130213    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret podName:83f7da9e-35c2-4854-a811-ebcce303e908 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:07.130194374 +0000 UTC m=+66.223839778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret") pod "global-pull-secret-syncer-8t2fg" (UID: "83f7da9e-35c2-4854-a811-ebcce303e908") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:16:35.130510 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.130239    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:35.130510 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.130303    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:17:07.130284865 +0000 UTC m=+66.223930283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:16:35.230722 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:35.230678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:35.230920 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.230882    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:16:35.230920 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.230910    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:16:35.231004 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.230925    2562 projected.go:196] Error preparing data for projected volume kube-api-access-4ld7w for pod openshift-network-diagnostics/network-check-target-hvbbs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:35.231004 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:35.230990    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w podName:20917a95-d33a-4f01-8bd6-ba8b3d2c639f nodeName:}" failed. No retries permitted until 2026-07-23 18:17:07.230970674 +0000 UTC m=+66.324616072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4ld7w" (UniqueName: "kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w") pod "network-check-target-hvbbs" (UID: "20917a95-d33a-4f01-8bd6-ba8b3d2c639f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:16:36.185615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.185545    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-146.ec2.internal" event="NodeReady"
Jul 23 18:16:36.186165 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.185665    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 18:16:36.218254 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.218220    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:16:36.222261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.222239    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.225393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.225257    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 18:16:36.225393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.225278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 18:16:36.225393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.225287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 18:16:36.225393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.225299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptt8h\""
Jul 23 18:16:36.234149 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.234124    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-674n8"]
Jul 23 18:16:36.234982 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.234817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 18:16:36.238844 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.238827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:16:36.238939 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.238856    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nqz7p"]
Jul 23 18:16:36.239009 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.238978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.241585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.241567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 18:16:36.241871 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.241848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 18:16:36.242161 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.242141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.242239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.242171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w4ck5\""
Jul 23 18:16:36.245818 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.245795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 18:16:36.245910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.245827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 18:16:36.246001 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.245982    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zbtqj\""
Jul 23 18:16:36.246081 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.246030    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 18:16:36.247783 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.247711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-674n8"]
Jul 23 18:16:36.249585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.249566    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nqz7p"]
Jul 23 18:16:36.336232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7dffed-4275-46ee-b961-32563c743a61-tmp-dir\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxx5\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb24t\" (UniqueName: \"kubernetes.io/projected/1a7dffed-4275-46ee-b961-32563c743a61-kube-api-access-cb24t\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a7dffed-4275-46ee-b961-32563c743a61-config-volume\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3215bb10-4a3b-4061-a7c5-ba08a9c49098-cert\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.336684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.336651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqc9\" (UniqueName: \"kubernetes.io/projected/3215bb10-4a3b-4061-a7c5-ba08a9c49098-kube-api-access-ncqc9\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.364537 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.364499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zkdd_c6cac72e-adc0-40a5-a935-b77cacbd790e/konnectivity-agent/0.log" limit=1024
Jul 23 18:16:36.437628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqc9\" (UniqueName: \"kubernetes.io/projected/3215bb10-4a3b-4061-a7c5-ba08a9c49098-kube-api-access-ncqc9\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7dffed-4275-46ee-b961-32563c743a61-tmp-dir\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.437789    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxx5\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.437853 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.437858    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:36.937836906 +0000 UTC m=+36.031482316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.437859    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.437880    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb24t\" (UniqueName: \"kubernetes.io/projected/1a7dffed-4275-46ee-b961-32563c743a61-kube-api-access-cb24t\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.437934    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:36.937917359 +0000 UTC m=+36.031562753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.437972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a7dffed-4275-46ee-b961-32563c743a61-config-volume\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3215bb10-4a3b-4061-a7c5-ba08a9c49098-cert\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a7dffed-4275-46ee-b961-32563c743a61-tmp-dir\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.438344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.438842 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1a7dffed-4275-46ee-b961-32563c743a61-config-volume\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.438842 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.438777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.439123 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.439096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.442514 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.442471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.442514 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.442504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.442644 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.442515    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3215bb10-4a3b-4061-a7c5-ba08a9c49098-cert\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.447087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.447061    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb24t\" (UniqueName: \"kubernetes.io/projected/1a7dffed-4275-46ee-b961-32563c743a61-kube-api-access-cb24t\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.448402 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.448359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqc9\" (UniqueName: \"kubernetes.io/projected/3215bb10-4a3b-4061-a7c5-ba08a9c49098-kube-api-access-ncqc9\") pod \"ingress-canary-nqz7p\" (UID: \"3215bb10-4a3b-4061-a7c5-ba08a9c49098\") " pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.448887 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.448844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.449594 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.449574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxx5\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.475350 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.475324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8zkdd_c6cac72e-adc0-40a5-a935-b77cacbd790e/konnectivity-agent/0.log" limit=1024
Jul 23 18:16:36.556989 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.556957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nqz7p"
Jul 23 18:16:36.569195 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.569169    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:16:36.569195 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.569189    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:16:36.569344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.569203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:16:36.572304 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572282    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:16:36.572420 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572322    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:16:36.572524 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572498    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jsfk8\""
Jul 23 18:16:36.572619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572580    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:16:36.572686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572616    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7wd2\""
Jul 23 18:16:36.572750 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.572723    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:16:36.941785 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.941716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:36.941956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:36.941800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:36.941956 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.941883    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:36.941956 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.941892    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:36.941956 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.941903    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:36.941956 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.941950    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:37.941935569 +0000 UTC m=+37.035580977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:36.942188 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:36.941965    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:37.941959345 +0000 UTC m=+37.035604753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:37.949427 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:37.949227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:37.949471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:37.949339    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:37.949606    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:39.949580207 +0000 UTC m=+39.043225611 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:37.949665    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:37.949681    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:37.950035 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:37.949735    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:39.94971946 +0000 UTC m=+39.043364858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:37.955395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:37.955283    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nqz7p"]
Jul 23 18:16:37.964880 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:37.964855    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3215bb10_4a3b_4061_a7c5_ba08a9c49098.slice/crio-bd355a4a8c96c745662e4eab602ecd670594a5562ac8dce1b47d60a088b08a7d WatchSource:0}: Error finding container bd355a4a8c96c745662e4eab602ecd670594a5562ac8dce1b47d60a088b08a7d: Status 404 returned error can't find the container with id bd355a4a8c96c745662e4eab602ecd670594a5562ac8dce1b47d60a088b08a7d
Jul 23 18:16:38.751540 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:38.751506    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="85c383e3461e22169cdf108c9168b3b3c8cc7d5cb18a46007a19b5ff37b5e5c2" exitCode=0
Jul 23 18:16:38.751731 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:38.751590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"85c383e3461e22169cdf108c9168b3b3c8cc7d5cb18a46007a19b5ff37b5e5c2"}
Jul 23 18:16:38.752607 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:38.752585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nqz7p" event={"ID":"3215bb10-4a3b-4061-a7c5-ba08a9c49098","Type":"ContainerStarted","Data":"bd355a4a8c96c745662e4eab602ecd670594a5562ac8dce1b47d60a088b08a7d"}
Jul 23 18:16:39.758117 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:39.758081    2562 generic.go:356] "Generic (PLEG): container finished" podID="04e40790-7de4-400b-9d8b-3f302877e2b5" containerID="5f714cfd7cbec9346e97e7fa084e21e11c3d431363129acd8c9bf80d29dacf70" exitCode=0
Jul 23 18:16:39.758474 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:39.758126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerDied","Data":"5f714cfd7cbec9346e97e7fa084e21e11c3d431363129acd8c9bf80d29dacf70"}
Jul 23 18:16:39.965496 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:39.965455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:39.965674 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:39.965524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:39.965674 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:39.965624    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:39.965779 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:39.965628    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:39.965779 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:39.965703    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:39.965779 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:39.965692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:43.965670602 +0000 UTC m=+43.059316020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:39.965779 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:39.965777    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:43.965753503 +0000 UTC m=+43.059398911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:40.765276 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:40.765001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" event={"ID":"04e40790-7de4-400b-9d8b-3f302877e2b5","Type":"ContainerStarted","Data":"9b976cd309b54e934bf57477d0c415af30b68f05920507a8f1d7b08da220b593"}
Jul 23 18:16:40.790353 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:40.790283    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5x9hn" podStartSLOduration=8.014926465 podStartE2EDuration="38.790259314s" totalImagesPullingTime="30.775332849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:40.787747451 +0000 UTC m=+39.881392881" watchObservedRunningTime="2026-07-23 18:16:40.790259314 +0000 UTC m=+39.883904732"
Jul 23 18:16:42.770416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:42.770378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nqz7p" event={"ID":"3215bb10-4a3b-4061-a7c5-ba08a9c49098","Type":"ContainerStarted","Data":"2eb9c849b592c6a986bbaf4e2724775f072808773f0a7380decf253673ce256b"}
Jul 23 18:16:42.786717 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:42.786659    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nqz7p" podStartSLOduration=2.412425937 podStartE2EDuration="6.78664161s" totalImagesPullingTime="4.374215673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:42.785555763 +0000 UTC m=+41.879201180" watchObservedRunningTime="2026-07-23 18:16:42.78664161 +0000 UTC m=+41.880287030"
Jul 23 18:16:43.993524 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:43.993451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:43.993534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:43.993615    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:43.993652    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:43.993668    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:43.993684    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:51.99366935 +0000 UTC m=+51.087314744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:43.993958 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:43.993719    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:51.993704254 +0000 UTC m=+51.087349649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:52.055867 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.055829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:16:52.055867 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.055876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:16:52.056390 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.055993    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:16:52.056390 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.056054    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls podName:1a7dffed-4275-46ee-b961-32563c743a61 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:08.056039229 +0000 UTC m=+67.149684628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls") pod "dns-default-674n8" (UID: "1a7dffed-4275-46ee-b961-32563c743a61") : secret "dns-default-metrics-tls" not found
Jul 23 18:16:52.056390 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.055997    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:16:52.056390 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.056102    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858cd557c8-pjdz5: secret "image-registry-tls" not found
Jul 23 18:16:52.056390 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.056156    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls podName:96c141e7-8138-421f-b752-c14c9f5a4ba5 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:08.056143769 +0000 UTC m=+67.149789164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls") pod "image-registry-858cd557c8-pjdz5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5") : secret "image-registry-tls" not found
Jul 23 18:16:52.707064 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.707022    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"]
Jul 23 18:16:52.722604 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.722566    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"]
Jul 23 18:16:52.722747 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.722702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.727708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.727655    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 18:16:52.727833 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.727714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 18:16:52.729016 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.728990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h4cwz\""
Jul 23 18:16:52.729016 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.729009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 18:16:52.729219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.729036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 18:16:52.761046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.761011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.761205 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.761069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6mw\" (UniqueName: \"kubernetes.io/projected/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-kube-api-access-2x6mw\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.761205 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.761163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.806886 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.806854    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"]
Jul 23 18:16:52.822762 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.822736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"]
Jul 23 18:16:52.822916 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.822862    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.825545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.825523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 18:16:52.825940 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.825895    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:16:52.826084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.825961    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 18:16:52.826208 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.826192    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 18:16:52.826661 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.826640    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f2zrr\""
Jul 23 18:16:52.837094 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.837070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"]
Jul 23 18:16:52.837219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.837105    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"]
Jul 23 18:16:52.837219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.837210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:52.839954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.839931    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 18:16:52.839954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.839947    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x8klq\""
Jul 23 18:16:52.840325 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.840310    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 18:16:52.840413 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.840312    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:16:52.862134 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4252e94-4d71-4e96-a784-9e67118c1396-serving-cert\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.862260 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:52.862260 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.862260 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4252e94-4d71-4e96-a784-9e67118c1396-config\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.862395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6mw\" (UniqueName: \"kubernetes.io/projected/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-kube-api-access-2x6mw\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.862395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/cc19396b-662a-4c13-88bc-a3fa2e6a4862-kube-api-access-th5ns\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:52.862395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.862395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.862375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdff6\" (UniqueName: \"kubernetes.io/projected/d4252e94-4d71-4e96-a784-9e67118c1396-kube-api-access-xdff6\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.863269 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.862799    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:52.863269 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.862903    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:16:53.362863241 +0000 UTC m=+52.456508638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:52.863437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.863319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.872757 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.872737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6mw\" (UniqueName: \"kubernetes.io/projected/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-kube-api-access-2x6mw\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:52.909159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.909126    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"]
Jul 23 18:16:52.926976 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.926945    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rllx6"]
Jul 23 18:16:52.927161 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.927100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:52.930303 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.930279    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 18:16:52.930518 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.930291    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 18:16:52.930624 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.930308    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-m6j56\""
Jul 23 18:16:52.930624 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.930439    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 18:16:52.930742 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.930628    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:16:52.949064 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.949041    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rllx6"]
Jul 23 18:16:52.949064 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.949070    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"]
Jul 23 18:16:52.949211 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.949154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.951997 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.951969    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 18:16:52.952126 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.952086    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h2nwj\""
Jul 23 18:16:52.952126 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.952121    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 18:16:52.952240 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.952126    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 18:16:52.952240 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.952143    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 18:16:52.956714 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.956693    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 18:16:52.963104 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c4116e-ea42-44a9-ad68-686bf84e4e99-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:52.963104 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c4116e-ea42-44a9-ad68-686bf84e4e99-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:52.963209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdff6\" (UniqueName: \"kubernetes.io/projected/d4252e94-4d71-4e96-a784-9e67118c1396-kube-api-access-xdff6\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.963209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-serving-cert\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.963209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgq6g\" (UniqueName: \"kubernetes.io/projected/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-kube-api-access-bgq6g\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.963209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hh4z\" (UniqueName: \"kubernetes.io/projected/33c4116e-ea42-44a9-ad68-686bf84e4e99-kube-api-access-7hh4z\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:52.963396 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:52.963396 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4252e94-4d71-4e96-a784-9e67118c1396-serving-cert\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.963396 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.963307    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:16:52.963396 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-tmp\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.963396 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:52.963363    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls podName:cc19396b-662a-4c13-88bc-a3fa2e6a4862 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:53.463345608 +0000 UTC m=+52.556991004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-lbsrq" (UID: "cc19396b-662a-4c13-88bc-a3fa2e6a4862") : secret "samples-operator-tls" not found
Jul 23 18:16:52.963612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-service-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.963612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4252e94-4d71-4e96-a784-9e67118c1396-config\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.963612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.963612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/cc19396b-662a-4c13-88bc-a3fa2e6a4862-kube-api-access-th5ns\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:52.963612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-snapshots\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:52.964003 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.963983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d4252e94-4d71-4e96-a784-9e67118c1396-config\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.965803 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.965781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d4252e94-4d71-4e96-a784-9e67118c1396-serving-cert\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.973704 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.973683    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdff6\" (UniqueName: \"kubernetes.io/projected/d4252e94-4d71-4e96-a784-9e67118c1396-kube-api-access-xdff6\") pod \"service-ca-operator-5bcbc94c78-k2fwf\" (UID: \"d4252e94-4d71-4e96-a784-9e67118c1396\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:52.973809 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:52.973794    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/cc19396b-662a-4c13-88bc-a3fa2e6a4862-kube-api-access-th5ns\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:53.064729 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c4116e-ea42-44a9-ad68-686bf84e4e99-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.064729 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c4116e-ea42-44a9-ad68-686bf84e4e99-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-serving-cert\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgq6g\" (UniqueName: \"kubernetes.io/projected/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-kube-api-access-bgq6g\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hh4z\" (UniqueName: \"kubernetes.io/projected/33c4116e-ea42-44a9-ad68-686bf84e4e99-kube-api-access-7hh4z\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-tmp\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-service-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.064958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-snapshots\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.065628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.065410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33c4116e-ea42-44a9-ad68-686bf84e4e99-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.067560 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.067538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33c4116e-ea42-44a9-ad68-686bf84e4e99-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.074014 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.073993    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hh4z\" (UniqueName: \"kubernetes.io/projected/33c4116e-ea42-44a9-ad68-686bf84e4e99-kube-api-access-7hh4z\") pod \"kube-storage-version-migrator-operator-7658d9b749-878rf\" (UID: \"33c4116e-ea42-44a9-ad68-686bf84e4e99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.076984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.076959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-tmp\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.077092 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.076990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-service-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.077092 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.077057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-snapshots\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.077092 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.077075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-serving-cert\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.077271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.077255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgq6g\" (UniqueName: \"kubernetes.io/projected/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-kube-api-access-bgq6g\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.077310 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.077300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a2d4021-244c-4afb-aa43-7cbeefd81d6d-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rllx6\" (UID: \"2a2d4021-244c-4afb-aa43-7cbeefd81d6d\") " pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.132346 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.132314    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"
Jul 23 18:16:53.236988 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.236958    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"
Jul 23 18:16:53.258076 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.258045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rllx6"
Jul 23 18:16:53.273149 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.273018    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf"]
Jul 23 18:16:53.276167 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:53.276143    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4252e94_4d71_4e96_a784_9e67118c1396.slice/crio-a5e07209f57165f3a3f2a2018e4167efe36293a0f474b4367b3720c21def8f6c WatchSource:0}: Error finding container a5e07209f57165f3a3f2a2018e4167efe36293a0f474b4367b3720c21def8f6c: Status 404 returned error can't find the container with id a5e07209f57165f3a3f2a2018e4167efe36293a0f474b4367b3720c21def8f6c
Jul 23 18:16:53.367275 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.367240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:53.367439 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:53.367371    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:53.367500 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:53.367451    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:16:54.367429848 +0000 UTC m=+53.461075247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:53.392157 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.392003    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf"]
Jul 23 18:16:53.394576 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:53.394548    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c4116e_ea42_44a9_ad68_686bf84e4e99.slice/crio-5fff436f4ad448ee39166bd10f7823a0b1c8cc9864224857f62cfd28316bbf50 WatchSource:0}: Error finding container 5fff436f4ad448ee39166bd10f7823a0b1c8cc9864224857f62cfd28316bbf50: Status 404 returned error can't find the container with id 5fff436f4ad448ee39166bd10f7823a0b1c8cc9864224857f62cfd28316bbf50
Jul 23 18:16:53.414696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.414662    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rllx6"]
Jul 23 18:16:53.417115 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:16:53.417086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2d4021_244c_4afb_aa43_7cbeefd81d6d.slice/crio-e424bb15a34066e2498c215291b148ed081d426bbf78bac8f3189b2f3bd486c0 WatchSource:0}: Error finding container e424bb15a34066e2498c215291b148ed081d426bbf78bac8f3189b2f3bd486c0: Status 404 returned error can't find the container with id e424bb15a34066e2498c215291b148ed081d426bbf78bac8f3189b2f3bd486c0
Jul 23 18:16:53.468037 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.468000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:53.468186 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:53.468153    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:16:53.468248 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:53.468221    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls podName:cc19396b-662a-4c13-88bc-a3fa2e6a4862 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:54.468204931 +0000 UTC m=+53.561850329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-lbsrq" (UID: "cc19396b-662a-4c13-88bc-a3fa2e6a4862") : secret "samples-operator-tls" not found
Jul 23 18:16:53.795233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.795192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rllx6" event={"ID":"2a2d4021-244c-4afb-aa43-7cbeefd81d6d","Type":"ContainerStarted","Data":"e424bb15a34066e2498c215291b148ed081d426bbf78bac8f3189b2f3bd486c0"}
Jul 23 18:16:53.796168 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.796141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf" event={"ID":"d4252e94-4d71-4e96-a784-9e67118c1396","Type":"ContainerStarted","Data":"a5e07209f57165f3a3f2a2018e4167efe36293a0f474b4367b3720c21def8f6c"}
Jul 23 18:16:53.797144 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:53.797127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf" event={"ID":"33c4116e-ea42-44a9-ad68-686bf84e4e99","Type":"ContainerStarted","Data":"5fff436f4ad448ee39166bd10f7823a0b1c8cc9864224857f62cfd28316bbf50"}
Jul 23 18:16:54.376942 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:54.376898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:54.377360 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:54.377028    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:54.377360 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:54.377085    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:16:56.377069589 +0000 UTC m=+55.470714984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:54.477676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:54.477633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:54.477915 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:54.477889    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:16:54.477996 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:54.477979    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls podName:cc19396b-662a-4c13-88bc-a3fa2e6a4862 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:56.477957431 +0000 UTC m=+55.571602829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-lbsrq" (UID: "cc19396b-662a-4c13-88bc-a3fa2e6a4862") : secret "samples-operator-tls" not found
Jul 23 18:16:56.395657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.395616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:16:56.396204 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:56.395749    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:56.396204 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:56.395827    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:17:00.395807948 +0000 UTC m=+59.489453348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:16:56.497198 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.497161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:16:56.497376 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:56.497311    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:16:56.497376 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:56.497370    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls podName:cc19396b-662a-4c13-88bc-a3fa2e6a4862 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:00.497355753 +0000 UTC m=+59.591001152 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-lbsrq" (UID: "cc19396b-662a-4c13-88bc-a3fa2e6a4862") : secret "samples-operator-tls" not found
Jul 23 18:16:56.807156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.807118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rllx6" event={"ID":"2a2d4021-244c-4afb-aa43-7cbeefd81d6d","Type":"ContainerStarted","Data":"e4ef04e900b23bd8b49848c7264303321f0ed8c0de91a1152a1e3db253ec9b3b"}
Jul 23 18:16:56.809229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.809184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf" event={"ID":"d4252e94-4d71-4e96-a784-9e67118c1396","Type":"ContainerStarted","Data":"9a8b9e2bd918659f75a5e03ea368789acb9f3f47165d798068780538c33a3a25"}
Jul 23 18:16:56.811001 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.810955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf" event={"ID":"33c4116e-ea42-44a9-ad68-686bf84e4e99","Type":"ContainerStarted","Data":"b07c9bcd6b1f11720e9fdb97d303c97d7233fd371672f1d319ab68cc9c1a2bac"}
Jul 23 18:16:56.847250 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.847190    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf" podStartSLOduration=1.438514889 podStartE2EDuration="4.847168516s" totalImagesPullingTime="3.408653627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:56.846230144 +0000 UTC m=+55.939875555" watchObservedRunningTime="2026-07-23 18:16:56.847168516 +0000 UTC m=+55.940813935"
Jul 23 18:16:56.847427 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.847294    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-rllx6" podStartSLOduration=1.58335447 podStartE2EDuration="4.847287756s" totalImagesPullingTime="3.263933286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:56.824317273 +0000 UTC m=+55.917962692" watchObservedRunningTime="2026-07-23 18:16:56.847287756 +0000 UTC m=+55.940933175"
Jul 23 18:16:56.864603 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:56.864543    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf" podStartSLOduration=1.582788157 podStartE2EDuration="4.864521908s" totalImagesPullingTime="3.281733751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:56.863186673 +0000 UTC m=+55.956832090" watchObservedRunningTime="2026-07-23 18:16:56.864521908 +0000 UTC m=+55.958167326"
Jul 23 18:16:58.897441 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.897409    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vvtr4"]
Jul 23 18:16:58.900295 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.900271    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:58.906305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.906284    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 18:16:58.906442 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.906373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ccngx\""
Jul 23 18:16:58.906877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.906844    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 18:16:58.923682 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:58.923655    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvtr4"]
Jul 23 18:16:59.017561 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.017527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.017561 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.017565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-data-volume\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.017763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.017600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-crio-socket\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.017763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.017658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.017763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.017716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsp2\" (UniqueName: \"kubernetes.io/projected/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-api-access-lbsp2\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118632 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118632 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-data-volume\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-crio-socket\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.118750    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsp2\" (UniqueName: \"kubernetes.io/projected/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-api-access-lbsp2\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.118803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-crio-socket\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.118876 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.118818    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:59.618797819 +0000 UTC m=+58.712443233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:16:59.119125 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.118889    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:16:59.119125 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.118996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:16:59.618976172 +0000 UTC m=+58.712621589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : configmap "kube-rbac-proxy" not found
Jul 23 18:16:59.119125 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.119002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-data-volume\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.127794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.127772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsp2\" (UniqueName: \"kubernetes.io/projected/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-api-access-lbsp2\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.623444 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.623408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.623679 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:16:59.623547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:16:59.623679 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.623562    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:16:59.623679 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.623633    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:00.62361354 +0000 UTC m=+59.717258935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : configmap "kube-rbac-proxy" not found
Jul 23 18:16:59.623679 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.623651    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:16:59.623902 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:16:59.623696    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:00.623682178 +0000 UTC m=+59.717327575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:00.318205 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.318170    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k4vz7"]
Jul 23 18:17:00.321661 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.321641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.324841 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.324812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 18:17:00.324945 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.324812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 18:17:00.324945 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.324812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kq4c5\""
Jul 23 18:17:00.326029 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.326012    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 18:17:00.326029 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.326024    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 18:17:00.330900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.330870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k4vz7"]
Jul 23 18:17:00.429387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.429343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zbp\" (UniqueName: \"kubernetes.io/projected/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-kube-api-access-w5zbp\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.429615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.429530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-cabundle\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.429615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.429600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-key\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.429713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.429646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:17:00.429753 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.429738    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:17:00.429810 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.429792    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:17:08.429779913 +0000 UTC m=+67.523425308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:17:00.530883 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.530842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:17:00.530883 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.530885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-key\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.531080 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.530935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zbp\" (UniqueName: \"kubernetes.io/projected/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-kube-api-access-w5zbp\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.531080 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.531002    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 18:17:00.531166 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.531014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-cabundle\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.531166 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.531107    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls podName:cc19396b-662a-4c13-88bc-a3fa2e6a4862 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:08.531071628 +0000 UTC m=+67.624717041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-lbsrq" (UID: "cc19396b-662a-4c13-88bc-a3fa2e6a4862") : secret "samples-operator-tls" not found
Jul 23 18:17:00.531693 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.531676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-cabundle\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.533354 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.533332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-signing-key\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.540361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.540333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zbp\" (UniqueName: \"kubernetes.io/projected/9ee2c48a-724e-4fe2-a6d6-bae88f8dae84-kube-api-access-w5zbp\") pod \"service-ca-58598695f7-k4vz7\" (UID: \"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84\") " pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.632131 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.632041    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-k4vz7"
Jul 23 18:17:00.632279 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.632222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:00.632279 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.632275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:00.632376 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.632362    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:17:00.632414 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.632374    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:00.632447 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.632425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:02.632410343 +0000 UTC m=+61.726055738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : configmap "kube-rbac-proxy" not found
Jul 23 18:17:00.632447 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:00.632438    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:02.632432008 +0000 UTC m=+61.726077403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:00.760369 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.760318    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-k4vz7"]
Jul 23 18:17:00.762757 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:00.762732    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee2c48a_724e_4fe2_a6d6_bae88f8dae84.slice/crio-a2f023f95f5015073d1b9c877381092b403f4f01d5594842da01569315163033 WatchSource:0}: Error finding container a2f023f95f5015073d1b9c877381092b403f4f01d5594842da01569315163033: Status 404 returned error can't find the container with id a2f023f95f5015073d1b9c877381092b403f4f01d5594842da01569315163033
Jul 23 18:17:00.822122 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:00.822089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k4vz7" event={"ID":"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84","Type":"ContainerStarted","Data":"a2f023f95f5015073d1b9c877381092b403f4f01d5594842da01569315163033"}
Jul 23 18:17:01.276462 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:01.276432    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmcxl_ade9c15f-dc6f-4b81-a470-5eec01f93f2f/dns-node-resolver/0.log"
Jul 23 18:17:01.747040 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:01.746959    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rtxvw"
Jul 23 18:17:01.826680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:01.826646    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-k4vz7" event={"ID":"9ee2c48a-724e-4fe2-a6d6-bae88f8dae84","Type":"ContainerStarted","Data":"84f9ae87afaea32ac25ef4504123b3bd983b97ef99da40df8c21e11583f599fd"}
Jul 23 18:17:01.848206 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:01.847587    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-k4vz7" podStartSLOduration=1.847565888 podStartE2EDuration="1.847565888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:01.845973033 +0000 UTC m=+60.939618450" watchObservedRunningTime="2026-07-23 18:17:01.847565888 +0000 UTC m=+60.941211306"
Jul 23 18:17:02.274109 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:02.274076    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs7xj_97fb56ac-194c-4bc6-b38f-382f255e7961/node-ca/0.log"
Jul 23 18:17:02.651676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:02.651589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:02.651676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:02.651668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:02.651883 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:02.651734    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:17:02.651883 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:02.651744    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:02.651883 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:02.651797    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:06.65177842 +0000 UTC m=+65.745423830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : configmap "kube-rbac-proxy" not found
Jul 23 18:17:02.651883 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:02.651818    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:06.651806021 +0000 UTC m=+65.745451426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:03.073402 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:03.073373    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nqz7p_3215bb10-4a3b-4061-a7c5-ba08a9c49098/serve-healthcheck-canary/0.log"
Jul 23 18:17:03.674115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:03.674086    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-878rf_33c4116e-ea42-44a9-ad68-686bf84e4e99/kube-storage-version-migrator-operator/0.log"
Jul 23 18:17:06.686841 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:06.686807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:06.687272 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:06.686869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:06.687272 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:06.686949    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:06.687272 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:06.687021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:14.687006126 +0000 UTC m=+73.780651522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:17:06.687272 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:06.686951    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:17:06.687272 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:06.687124    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm podName:2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3 nodeName:}" failed. No retries permitted until 2026-07-23 18:17:14.687101754 +0000 UTC m=+73.780747154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vvtr4" (UID: "2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3") : configmap "kube-rbac-proxy" not found
Jul 23 18:17:07.190740 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.190699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:17:07.190941 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.190819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:17:07.193770 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.193750    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:17:07.193847 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.193791    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:17:07.201310 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:07.201280    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 23 18:17:07.201401 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:07.201351    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs podName:e27641c4-1d54-415b-a312-41c8364255ab nodeName:}" failed. No retries permitted until 2026-07-23 18:18:11.201332248 +0000 UTC m=+130.294977648 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs") pod "network-metrics-daemon-vwhbl" (UID: "e27641c4-1d54-415b-a312-41c8364255ab") : secret "metrics-daemon-secret" not found
Jul 23 18:17:07.203362 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.203341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/83f7da9e-35c2-4854-a811-ebcce303e908-original-pull-secret\") pod \"global-pull-secret-syncer-8t2fg\" (UID: \"83f7da9e-35c2-4854-a811-ebcce303e908\") " pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:17:07.292156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.292122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:17:07.295160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.295139    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:17:07.304973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.304950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:17:07.315781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.315753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ld7w\" (UniqueName: \"kubernetes.io/projected/20917a95-d33a-4f01-8bd6-ba8b3d2c639f-kube-api-access-4ld7w\") pod \"network-check-target-hvbbs\" (UID: \"20917a95-d33a-4f01-8bd6-ba8b3d2c639f\") " pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:17:07.489005 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.488927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8t2fg"
Jul 23 18:17:07.497059 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.497036    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w7wd2\""
Jul 23 18:17:07.504402 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.504377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:17:07.626224 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.626197    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8t2fg"]
Jul 23 18:17:07.628716 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:07.628688    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f7da9e_35c2_4854_a811_ebcce303e908.slice/crio-e1c301204a29142f93cf438f75fa93b06cd331f5538e71255481753e8f780eae WatchSource:0}: Error finding container e1c301204a29142f93cf438f75fa93b06cd331f5538e71255481753e8f780eae: Status 404 returned error can't find the container with id e1c301204a29142f93cf438f75fa93b06cd331f5538e71255481753e8f780eae
Jul 23 18:17:07.644763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.644738    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hvbbs"]
Jul 23 18:17:07.647868 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:07.647840    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20917a95_d33a_4f01_8bd6_ba8b3d2c639f.slice/crio-0b9264ccd43bcece0911974afdc99e295498e73134aa3bc8b3676504c77d262b WatchSource:0}: Error finding container 0b9264ccd43bcece0911974afdc99e295498e73134aa3bc8b3676504c77d262b: Status 404 returned error can't find the container with id 0b9264ccd43bcece0911974afdc99e295498e73134aa3bc8b3676504c77d262b
Jul 23 18:17:07.842713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.842680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvbbs" event={"ID":"20917a95-d33a-4f01-8bd6-ba8b3d2c639f","Type":"ContainerStarted","Data":"0b9264ccd43bcece0911974afdc99e295498e73134aa3bc8b3676504c77d262b"}
Jul 23 18:17:07.843788 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:07.843765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t2fg" event={"ID":"83f7da9e-35c2-4854-a811-ebcce303e908","Type":"ContainerStarted","Data":"e1c301204a29142f93cf438f75fa93b06cd331f5538e71255481753e8f780eae"}
Jul 23 18:17:08.098522 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.098417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:17:08.098522 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.098507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:17:08.100768 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.100739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a7dffed-4275-46ee-b961-32563c743a61-metrics-tls\") pod \"dns-default-674n8\" (UID: \"1a7dffed-4275-46ee-b961-32563c743a61\") " pod="openshift-dns/dns-default-674n8"
Jul 23 18:17:08.100882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.100850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"image-registry-858cd557c8-pjdz5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") " pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:17:08.337940 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.337884    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptt8h\""
Jul 23 18:17:08.346156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.346114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:17:08.354505 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.354244    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w4ck5\""
Jul 23 18:17:08.362647 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.362627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-674n8"
Jul 23 18:17:08.503523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.503469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:17:08.504209 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:08.503695    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 18:17:08.504209 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:17:08.503781    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls podName:e7da54e1-ab75-41ad-9229-cee29e1bb9ac nodeName:}" failed. No retries permitted until 2026-07-23 18:17:24.50375808 +0000 UTC m=+83.597403478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-cthmx" (UID: "e7da54e1-ab75-41ad-9229-cee29e1bb9ac") : secret "cluster-monitoring-operator-tls" not found
Jul 23 18:17:08.530585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.530531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:17:08.556523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.556459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-674n8"]
Jul 23 18:17:08.559251 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:08.559222    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7dffed_4275_46ee_b961_32563c743a61.slice/crio-ff87921154a033dd2b3652379fb176fc680c6120b3ccb1b0b79871e3d4f1b8fd WatchSource:0}: Error finding container ff87921154a033dd2b3652379fb176fc680c6120b3ccb1b0b79871e3d4f1b8fd: Status 404 returned error can't find the container with id ff87921154a033dd2b3652379fb176fc680c6120b3ccb1b0b79871e3d4f1b8fd
Jul 23 18:17:08.605066 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.604998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:17:08.608939 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.608832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cc19396b-662a-4c13-88bc-a3fa2e6a4862-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-lbsrq\" (UID: \"cc19396b-662a-4c13-88bc-a3fa2e6a4862\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:17:08.748044 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.748009    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-x8klq\""
Jul 23 18:17:08.756212 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.756178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"
Jul 23 18:17:08.852317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.852279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-674n8" event={"ID":"1a7dffed-4275-46ee-b961-32563c743a61","Type":"ContainerStarted","Data":"ff87921154a033dd2b3652379fb176fc680c6120b3ccb1b0b79871e3d4f1b8fd"}
Jul 23 18:17:08.854582 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.854059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" event={"ID":"96c141e7-8138-421f-b752-c14c9f5a4ba5","Type":"ContainerStarted","Data":"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"}
Jul 23 18:17:08.854582 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.854096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" event={"ID":"96c141e7-8138-421f-b752-c14c9f5a4ba5","Type":"ContainerStarted","Data":"a16ce4be19c8dd3d79d0d327e79da753ef532a9ba23ad9492af9b2e7d8f550df"}
Jul 23 18:17:08.854582 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.854141    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:17:08.878781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.878724    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" podStartSLOduration=66.878698823 podStartE2EDuration="1m6.878698823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:08.878025951 +0000 UTC m=+67.971671366" watchObservedRunningTime="2026-07-23 18:17:08.878698823 +0000 UTC m=+67.972344222"
Jul 23 18:17:08.929525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:08.929491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq"]
Jul 23 18:17:09.860847 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:09.860761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq" event={"ID":"cc19396b-662a-4c13-88bc-a3fa2e6a4862","Type":"ContainerStarted","Data":"8f73b428eb22c3d56ca66c13b77f0c963996b856b896aaa1dddf3affb0ed1bb1"}
Jul 23 18:17:14.761048 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.761008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:14.761458 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.761065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:14.761628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.761610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:14.763321 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.763301    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vvtr4\" (UID: \"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3\") " pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:14.813403 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.813367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ccngx\""
Jul 23 18:17:14.820653 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.820628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vvtr4"
Jul 23 18:17:14.883321 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.882726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hvbbs" event={"ID":"20917a95-d33a-4f01-8bd6-ba8b3d2c639f","Type":"ContainerStarted","Data":"e81711251e2ff73c1ba8e8efa7d79432cd0b861a566a369226dd668714f55c64"}
Jul 23 18:17:14.883504 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.883433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:17:14.885227 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.885197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8t2fg" event={"ID":"83f7da9e-35c2-4854-a811-ebcce303e908","Type":"ContainerStarted","Data":"e795457635bf4862e39550b0319267d855d6ec203314ef175aa0c93780ba2438"}
Jul 23 18:17:14.887951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.887506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq" event={"ID":"cc19396b-662a-4c13-88bc-a3fa2e6a4862","Type":"ContainerStarted","Data":"8c42c3ffc5ac3fc208088428b700296ebb3a6195168381a114efcd424110b397"}
Jul 23 18:17:14.887951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.887552    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq" event={"ID":"cc19396b-662a-4c13-88bc-a3fa2e6a4862","Type":"ContainerStarted","Data":"fef8b9033b51e5039d6698946dea8579e07b13fca491a33231b1558fb6b9610c"}
Jul 23 18:17:14.889733 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.889656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-674n8" event={"ID":"1a7dffed-4275-46ee-b961-32563c743a61","Type":"ContainerStarted","Data":"e7c8952b5dfa4116ea88042c85febb2bc95ffb4e0da52f91449d0f2872370a2d"}
Jul 23 18:17:14.889733 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.889699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-674n8" event={"ID":"1a7dffed-4275-46ee-b961-32563c743a61","Type":"ContainerStarted","Data":"98a3cd1085ff946f9a39efe9e8438894688b7a456704ee5db58ba3a22f2da171"}
Jul 23 18:17:14.889986 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.889941    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-674n8"
Jul 23 18:17:14.898133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.898053    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hvbbs" podStartSLOduration=66.607477525 podStartE2EDuration="1m12.898034338s" totalImagesPullingTime="6.290556813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:14.897993418 +0000 UTC m=+73.991638836" watchObservedRunningTime="2026-07-23 18:17:14.898034338 +0000 UTC m=+73.991679753"
Jul 23 18:17:14.915922 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.915878    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-674n8" podStartSLOduration=33.543441238 podStartE2EDuration="38.915853529s" totalImagesPullingTime="5.372412291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:14.915378198 +0000 UTC m=+74.009023618" watchObservedRunningTime="2026-07-23 18:17:14.915853529 +0000 UTC m=+74.009498946"
Jul 23 18:17:14.930385 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.930338    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8t2fg" podStartSLOduration=66.611661624 podStartE2EDuration="1m12.93032389s" totalImagesPullingTime="6.318662266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:14.929891759 +0000 UTC m=+74.023537179" watchObservedRunningTime="2026-07-23 18:17:14.93032389 +0000 UTC m=+74.023969307"
Jul 23 18:17:14.950718 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.950000    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-lbsrq" podStartSLOduration=18.008320386 podStartE2EDuration="22.949979003s" totalImagesPullingTime="4.941658617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:14.948166485 +0000 UTC m=+74.041811894" watchObservedRunningTime="2026-07-23 18:17:14.949979003 +0000 UTC m=+74.043624424"
Jul 23 18:17:14.952981 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:14.952698    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vvtr4"]
Jul 23 18:17:14.958441 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:14.958415    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2e2b2f_820e_439b_9692_2d2b4f4ebbd3.slice/crio-a619dff3021130b0125d33c3e06c70ef0b711f70f65d733a4b46f18841db074e WatchSource:0}: Error finding container a619dff3021130b0125d33c3e06c70ef0b711f70f65d733a4b46f18841db074e: Status 404 returned error can't find the container with id a619dff3021130b0125d33c3e06c70ef0b711f70f65d733a4b46f18841db074e
Jul 23 18:17:15.895369 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:15.895319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvtr4" event={"ID":"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3","Type":"ContainerStarted","Data":"a619dff3021130b0125d33c3e06c70ef0b711f70f65d733a4b46f18841db074e"}
Jul 23 18:17:19.911396 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:19.911360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvtr4" event={"ID":"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3","Type":"ContainerStarted","Data":"3aa705080a911c231a00337ea8a73dfbc43386cc7334f429af0cce69a62c515a"}
Jul 23 18:17:23.296010 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.295974    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"]
Jul 23 18:17:23.299078 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.299055    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"]
Jul 23 18:17:23.299224 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.299170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.301668 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.301646    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 18:17:23.301984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.301966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.302324 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.302243    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 18:17:23.302324 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.302306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 23 18:17:23.302324 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.302316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 18:17:23.306211 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.306189    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 18:17:23.306339 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.306297    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 18:17:23.306502 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.306450    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 18:17:23.306801 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.306781    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 18:17:23.314579 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.314556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"]
Jul 23 18:17:23.319237 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.319215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"]
Jul 23 18:17:23.433027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.432943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.432982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe97a2-2c29-408b-ad36-4425d299366d-tmp\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.433027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tcjb\" (UniqueName: \"kubernetes.io/projected/a34ed289-9d94-4a60-8261-58bb7c05d239-kube-api-access-6tcjb\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34ed289-9d94-4a60-8261-58bb7c05d239-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cfe97a2-2c29-408b-ad36-4425d299366d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.433361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.433361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.433276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvr7l\" (UniqueName: \"kubernetes.io/projected/6cfe97a2-2c29-408b-ad36-4425d299366d-kube-api-access-kvr7l\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.534254 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.534406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tcjb\" (UniqueName: \"kubernetes.io/projected/a34ed289-9d94-4a60-8261-58bb7c05d239-kube-api-access-6tcjb\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.534406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34ed289-9d94-4a60-8261-58bb7c05d239-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.534406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cfe97a2-2c29-408b-ad36-4425d299366d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.534406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.534406 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvr7l\" (UniqueName: \"kubernetes.io/projected/6cfe97a2-2c29-408b-ad36-4425d299366d-kube-api-access-kvr7l\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.534713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.534713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe97a2-2c29-408b-ad36-4425d299366d-tmp\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.534821 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.535149 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.534959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cfe97a2-2c29-408b-ad36-4425d299366d-tmp\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.535290 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.535268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a34ed289-9d94-4a60-8261-58bb7c05d239-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.537200 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.537141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6cfe97a2-2c29-408b-ad36-4425d299366d-klusterlet-config\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.537200 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.537170    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-ca\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.537536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.537514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.537614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.537570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.538068 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.538050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a34ed289-9d94-4a60-8261-58bb7c05d239-hub\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.545667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.545628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tcjb\" (UniqueName: \"kubernetes.io/projected/a34ed289-9d94-4a60-8261-58bb7c05d239-kube-api-access-6tcjb\") pod \"cluster-proxy-proxy-agent-78c5486945-tjb69\" (UID: \"a34ed289-9d94-4a60-8261-58bb7c05d239\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.547153 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.547132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvr7l\" (UniqueName: \"kubernetes.io/projected/6cfe97a2-2c29-408b-ad36-4425d299366d-kube-api-access-kvr7l\") pod \"klusterlet-addon-workmgr-5947cfd988-q57wj\" (UID: \"6cfe97a2-2c29-408b-ad36-4425d299366d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.610004 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.609886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:23.634512 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.634465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"
Jul 23 18:17:23.790462 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.787138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"]
Jul 23 18:17:23.813304 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.813274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69"]
Jul 23 18:17:23.816500 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:23.816461    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda34ed289_9d94_4a60_8261_58bb7c05d239.slice/crio-7278ba853acd6639546e83af06b16081fdc813b20f9703545013f94ddb6fc552 WatchSource:0}: Error finding container 7278ba853acd6639546e83af06b16081fdc813b20f9703545013f94ddb6fc552: Status 404 returned error can't find the container with id 7278ba853acd6639546e83af06b16081fdc813b20f9703545013f94ddb6fc552
Jul 23 18:17:23.927818 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.927776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj" event={"ID":"6cfe97a2-2c29-408b-ad36-4425d299366d","Type":"ContainerStarted","Data":"f116a1c10d123690bf4bdde7b0f7e0b9db088f3848f19ed6d5e96fffef7b8837"}
Jul 23 18:17:23.930046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.930016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvtr4" event={"ID":"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3","Type":"ContainerStarted","Data":"64c74f2bfe584afbd6fb7c17a4bbe08799510a7ad2cc142532801d23b40e74be"}
Jul 23 18:17:23.931283 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:23.931254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69" event={"ID":"a34ed289-9d94-4a60-8261-58bb7c05d239","Type":"ContainerStarted","Data":"7278ba853acd6639546e83af06b16081fdc813b20f9703545013f94ddb6fc552"}
Jul 23 18:17:24.544737 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:24.544692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:17:24.547412 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:24.547382    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e7da54e1-ab75-41ad-9229-cee29e1bb9ac-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-cthmx\" (UID: \"e7da54e1-ab75-41ad-9229-cee29e1bb9ac\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:17:24.835154 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:24.835077    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-h4cwz\""
Jul 23 18:17:24.843638 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:24.843607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"
Jul 23 18:17:24.898195 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:24.897450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-674n8"
Jul 23 18:17:25.015764 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:25.015740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx"]
Jul 23 18:17:25.021043 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:25.021008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7da54e1_ab75_41ad_9229_cee29e1bb9ac.slice/crio-3c93c29d372ff0c4d55f2e1387706a0ddfffb1fa2be7146dd7f8d74d386f0a46 WatchSource:0}: Error finding container 3c93c29d372ff0c4d55f2e1387706a0ddfffb1fa2be7146dd7f8d74d386f0a46: Status 404 returned error can't find the container with id 3c93c29d372ff0c4d55f2e1387706a0ddfffb1fa2be7146dd7f8d74d386f0a46
Jul 23 18:17:25.946722 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:25.946681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx" event={"ID":"e7da54e1-ab75-41ad-9229-cee29e1bb9ac","Type":"ContainerStarted","Data":"3c93c29d372ff0c4d55f2e1387706a0ddfffb1fa2be7146dd7f8d74d386f0a46"}
Jul 23 18:17:28.351765 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:28.351725    2562 patch_prober.go:28] interesting pod/image-registry-858cd557c8-pjdz5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 18:17:28.352217 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:28.351783    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:17:29.866416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:29.866384    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:17:31.971998 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.971966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx" event={"ID":"e7da54e1-ab75-41ad-9229-cee29e1bb9ac","Type":"ContainerStarted","Data":"c458ae0ef8a3110f21054043c64025498894ac1d9515e9af3250927894823ac3"}
Jul 23 18:17:31.973993 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.973965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69" event={"ID":"a34ed289-9d94-4a60-8261-58bb7c05d239","Type":"ContainerStarted","Data":"71b217b2d84784ebe5ad15dbd226354a1e7b7ad7e6be9ddcc484f8e84e6a359e"}
Jul 23 18:17:31.974113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.974005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69" event={"ID":"a34ed289-9d94-4a60-8261-58bb7c05d239","Type":"ContainerStarted","Data":"fea219c8aa65352fdeef43230348904901df57130321dfc1997cd9e0fbde4a92"}
Jul 23 18:17:31.974113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.974024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69" event={"ID":"a34ed289-9d94-4a60-8261-58bb7c05d239","Type":"ContainerStarted","Data":"34a6ede04b6acd0ddb3502e9f0b974588bf3337e73a75956ddc89af301f3f39a"}
Jul 23 18:17:31.975306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.975286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj" event={"ID":"6cfe97a2-2c29-408b-ad36-4425d299366d","Type":"ContainerStarted","Data":"ab72a6d5abd02150aa7b90657c4d4dac009e1fd421d54155ec6db133c57648e4"}
Jul 23 18:17:31.975456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.975439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:31.977326 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.977305    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj"
Jul 23 18:17:31.977523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.977505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vvtr4" event={"ID":"2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3","Type":"ContainerStarted","Data":"7744f9a36b963671bbe5d04b32f4ce153218fe3344c7d3f14397770548f21cd7"}
Jul 23 18:17:31.989443 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:31.989404    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-cthmx" podStartSLOduration=34.102596638 podStartE2EDuration="39.989390828s" totalImagesPullingTime="5.88679419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:31.988194505 +0000 UTC m=+91.081839921" watchObservedRunningTime="2026-07-23 18:17:31.989390828 +0000 UTC m=+91.083036244"
Jul 23 18:17:32.012116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:32.010040    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vvtr4" podStartSLOduration=19.904061461 podStartE2EDuration="34.010020489s" totalImagesPullingTime="14.105959028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:16:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:32.008687409 +0000 UTC m=+91.102332826" watchObservedRunningTime="2026-07-23 18:17:32.010020489 +0000 UTC m=+91.103665906"
Jul 23 18:17:32.025018 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:32.024977    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5947cfd988-q57wj" podStartSLOduration=1.8927109770000001 podStartE2EDuration="9.024963451s" totalImagesPullingTime="7.132252474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:32.024540671 +0000 UTC m=+91.118186088" watchObservedRunningTime="2026-07-23 18:17:32.024963451 +0000 UTC m=+91.118608868"
Jul 23 18:17:32.042525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:32.042464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78c5486945-tjb69" podStartSLOduration=1.9582939499999998 podStartE2EDuration="9.042450871s" totalImagesPullingTime="7.084156921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:32.041931404 +0000 UTC m=+91.135576820" watchObservedRunningTime="2026-07-23 18:17:32.042450871 +0000 UTC m=+91.136096342"
Jul 23 18:17:46.902462 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:46.902425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hvbbs"
Jul 23 18:17:47.387269 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.387235    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:17:47.883794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.883756    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t8pfp"]
Jul 23 18:17:47.908977 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.908950    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.915145 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.915118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 18:17:47.915301 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.915189    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 18:17:47.916085 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916063    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 18:17:47.916280 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-tls\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916354 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-textfile\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916411 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rw8\" (UniqueName: \"kubernetes.io/projected/c23d55cc-1565-4578-8d49-60755590a242-kube-api-access-h4rw8\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916411 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bvvxz\""
Jul 23 18:17:47.916411 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916411 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916402    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 18:17:47.916636 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916636 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-sys\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916636 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-root\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916636 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-wtmp\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:47.916802 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:47.916654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-metrics-client-ca\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.016960 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.016923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-tls\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.016977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-textfile\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rw8\" (UniqueName: \"kubernetes.io/projected/c23d55cc-1565-4578-8d49-60755590a242-kube-api-access-h4rw8\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-sys\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017148 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-sys\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-root\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-wtmp\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-metrics-client-ca\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-root\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-textfile\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.017640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.017578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-wtmp\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.018043 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.018022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-metrics-client-ca\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.018122 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.018080    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-accelerators-collector-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.019433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.019410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.019802 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.019783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c23d55cc-1565-4578-8d49-60755590a242-node-exporter-tls\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.027210 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.027179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rw8\" (UniqueName: \"kubernetes.io/projected/c23d55cc-1565-4578-8d49-60755590a242-kube-api-access-h4rw8\") pod \"node-exporter-t8pfp\" (UID: \"c23d55cc-1565-4578-8d49-60755590a242\") " pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.225906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:48.225824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t8pfp"
Jul 23 18:17:48.251652 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:17:48.251618    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23d55cc_1565_4578_8d49_60755590a242.slice/crio-220c5eb5d90871bb280b5d00a53918441ccee4f5cd2fdc794fe5907e9e4d80fe WatchSource:0}: Error finding container 220c5eb5d90871bb280b5d00a53918441ccee4f5cd2fdc794fe5907e9e4d80fe: Status 404 returned error can't find the container with id 220c5eb5d90871bb280b5d00a53918441ccee4f5cd2fdc794fe5907e9e4d80fe
Jul 23 18:17:49.035870 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:49.035834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8pfp" event={"ID":"c23d55cc-1565-4578-8d49-60755590a242","Type":"ContainerStarted","Data":"220c5eb5d90871bb280b5d00a53918441ccee4f5cd2fdc794fe5907e9e4d80fe"}
Jul 23 18:17:50.040781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:50.040743    2562 generic.go:356] "Generic (PLEG): container finished" podID="c23d55cc-1565-4578-8d49-60755590a242" containerID="4f7b1632ecc0ef3057c8093eaca02ea9da7472070d64a782b3cabb13f9a93d5d" exitCode=0
Jul 23 18:17:50.041172 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:50.040811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8pfp" event={"ID":"c23d55cc-1565-4578-8d49-60755590a242","Type":"ContainerDied","Data":"4f7b1632ecc0ef3057c8093eaca02ea9da7472070d64a782b3cabb13f9a93d5d"}
Jul 23 18:17:51.046335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:51.046300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8pfp" event={"ID":"c23d55cc-1565-4578-8d49-60755590a242","Type":"ContainerStarted","Data":"be1499fc3a2dff5a04407b11c5ac6c4e0a40e8162ead1c61dd603dc945b23038"}
Jul 23 18:17:51.046734 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:51.046349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t8pfp" event={"ID":"c23d55cc-1565-4578-8d49-60755590a242","Type":"ContainerStarted","Data":"c21c759c36ee0b8113b095be19876acf9d1f1033650dfc0124dee8c59ff251fa"}
Jul 23 18:17:51.071493 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:17:51.071445    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t8pfp" podStartSLOduration=2.741449512 podStartE2EDuration="4.071430192s" totalImagesPullingTime="1.258579348s" totalInitContainerRuntime="71.401332ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:17:51.069351341 +0000 UTC m=+110.162996782" watchObservedRunningTime="2026-07-23 18:17:51.071430192 +0000 UTC m=+110.165075608"
Jul 23 18:18:11.298168 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:11.298117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:18:11.300381 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:11.300362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e27641c4-1d54-415b-a312-41c8364255ab-metrics-certs\") pod \"network-metrics-daemon-vwhbl\" (UID: \"e27641c4-1d54-415b-a312-41c8364255ab\") " pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:18:11.383934 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:11.383902    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jsfk8\""
Jul 23 18:18:11.391301 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:11.391283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwhbl"
Jul 23 18:18:11.532045 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:11.532017    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vwhbl"]
Jul 23 18:18:11.535048 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:18:11.535021    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27641c4_1d54_415b_a312_41c8364255ab.slice/crio-450e03ef54a5eb6247883da3919d9dd7a90a3a49c2517068267c01b45419171f WatchSource:0}: Error finding container 450e03ef54a5eb6247883da3919d9dd7a90a3a49c2517068267c01b45419171f: Status 404 returned error can't find the container with id 450e03ef54a5eb6247883da3919d9dd7a90a3a49c2517068267c01b45419171f
Jul 23 18:18:12.118543 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.118505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwhbl" event={"ID":"e27641c4-1d54-415b-a312-41c8364255ab","Type":"ContainerStarted","Data":"450e03ef54a5eb6247883da3919d9dd7a90a3a49c2517068267c01b45419171f"}
Jul 23 18:18:12.407161 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.407070    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerName="registry" containerID="cri-o://68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1" gracePeriod=30
Jul 23 18:18:12.642753 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.642732    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:18:12.710716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710649    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.710716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710689    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfxx5\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.710891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710727    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.710891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.710891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.710891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.711063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.710848    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.711063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.711005    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") pod \"96c141e7-8138-421f-b752-c14c9f5a4ba5\" (UID: \"96c141e7-8138-421f-b752-c14c9f5a4ba5\") "
Jul 23 18:18:12.711129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.711113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:18:12.711258 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.711238    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-certificates\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.711645 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.711604    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:18:12.713367 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.713329    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:18:12.713473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.713413    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:18:12.713556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.713499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5" (OuterVolumeSpecName: "kube-api-access-wfxx5") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "kube-api-access-wfxx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:18:12.713668 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.713612    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:18:12.713832 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.713751    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:18:12.719137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.719111    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "96c141e7-8138-421f-b752-c14c9f5a4ba5" (UID: "96c141e7-8138-421f-b752-c14c9f5a4ba5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:18:12.811797 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811765    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96c141e7-8138-421f-b752-c14c9f5a4ba5-trusted-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811797 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811792    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-registry-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811797 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811801    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96c141e7-8138-421f-b752-c14c9f5a4ba5-ca-trust-extracted\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811809    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfxx5\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-kube-api-access-wfxx5\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811818    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96c141e7-8138-421f-b752-c14c9f5a4ba5-bound-sa-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811828    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-image-registry-private-configuration\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:12.811995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:12.811837    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96c141e7-8138-421f-b752-c14c9f5a4ba5-installation-pull-secrets\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:18:13.123965 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.123933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwhbl" event={"ID":"e27641c4-1d54-415b-a312-41c8364255ab","Type":"ContainerStarted","Data":"401107613a546ace6613bc41c2bdc550207325aca159d69a7ae14409a36b4c9c"}
Jul 23 18:18:13.124165 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.123991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwhbl" event={"ID":"e27641c4-1d54-415b-a312-41c8364255ab","Type":"ContainerStarted","Data":"e26c66ec15caf2db5d047a9961e3596982f5bdc44117045e56b2f1847d41705e"}
Jul 23 18:18:13.125091 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.125068    2562 generic.go:356] "Generic (PLEG): container finished" podID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerID="68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1" exitCode=0
Jul 23 18:18:13.125193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.125108    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5"
Jul 23 18:18:13.125193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.125147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" event={"ID":"96c141e7-8138-421f-b752-c14c9f5a4ba5","Type":"ContainerDied","Data":"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"}
Jul 23 18:18:13.125193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.125187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858cd557c8-pjdz5" event={"ID":"96c141e7-8138-421f-b752-c14c9f5a4ba5","Type":"ContainerDied","Data":"a16ce4be19c8dd3d79d0d327e79da753ef532a9ba23ad9492af9b2e7d8f550df"}
Jul 23 18:18:13.125350 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.125206    2562 scope.go:117] "RemoveContainer" containerID="68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"
Jul 23 18:18:13.133904 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.133889    2562 scope.go:117] "RemoveContainer" containerID="68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"
Jul 23 18:18:13.134132 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:18:13.134113    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1\": container with ID starting with 68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1 not found: ID does not exist" containerID="68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"
Jul 23 18:18:13.134181 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.134139    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1"} err="failed to get container status \"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1\": rpc error: code = NotFound desc = could not find container \"68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1\": container with ID starting with 68591e873f879c7f8fd00663dea80a6fac985f79d40f722be3f8bb6354a223a1 not found: ID does not exist"
Jul 23 18:18:13.141675 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.141638    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vwhbl" podStartSLOduration=130.208809873 podStartE2EDuration="2m11.141625586s" totalImagesPullingTime="932.815713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:18:13.141173002 +0000 UTC m=+132.234818425" watchObservedRunningTime="2026-07-23 18:18:13.141625586 +0000 UTC m=+132.235271003"
Jul 23 18:18:13.156564 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.156543    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:18:13.158922 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.158903    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-858cd557c8-pjdz5"]
Jul 23 18:18:13.576970 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:13.576936    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" path="/var/lib/kubelet/pods/96c141e7-8138-421f-b752-c14c9f5a4ba5/volumes"
Jul 23 18:18:23.162336 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.162299    2562 generic.go:356] "Generic (PLEG): container finished" podID="d4252e94-4d71-4e96-a784-9e67118c1396" containerID="9a8b9e2bd918659f75a5e03ea368789acb9f3f47165d798068780538c33a3a25" exitCode=0
Jul 23 18:18:23.162805 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.162373    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf" event={"ID":"d4252e94-4d71-4e96-a784-9e67118c1396","Type":"ContainerDied","Data":"9a8b9e2bd918659f75a5e03ea368789acb9f3f47165d798068780538c33a3a25"}
Jul 23 18:18:23.162805 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.162754    2562 scope.go:117] "RemoveContainer" containerID="9a8b9e2bd918659f75a5e03ea368789acb9f3f47165d798068780538c33a3a25"
Jul 23 18:18:23.163958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.163935    2562 generic.go:356] "Generic (PLEG): container finished" podID="33c4116e-ea42-44a9-ad68-686bf84e4e99" containerID="b07c9bcd6b1f11720e9fdb97d303c97d7233fd371672f1d319ab68cc9c1a2bac" exitCode=0
Jul 23 18:18:23.164072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.163989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf" event={"ID":"33c4116e-ea42-44a9-ad68-686bf84e4e99","Type":"ContainerDied","Data":"b07c9bcd6b1f11720e9fdb97d303c97d7233fd371672f1d319ab68cc9c1a2bac"}
Jul 23 18:18:23.164306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:23.164282    2562 scope.go:117] "RemoveContainer" containerID="b07c9bcd6b1f11720e9fdb97d303c97d7233fd371672f1d319ab68cc9c1a2bac"
Jul 23 18:18:24.168705 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:24.168672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-k2fwf" event={"ID":"d4252e94-4d71-4e96-a784-9e67118c1396","Type":"ContainerStarted","Data":"1a64d0627b8d957045dbb7502ecd569ba98dc60bd926b869ac31addb5fb74d5a"}
Jul 23 18:18:24.170363 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:24.170340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-878rf" event={"ID":"33c4116e-ea42-44a9-ad68-686bf84e4e99","Type":"ContainerStarted","Data":"b977a65ff6b2a3a6fb03b277a7be8e7a5fbf5a8ee6e5363ddcdfba35bfbc7663"}
Jul 23 18:18:33.203414 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:33.203377    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a2d4021-244c-4afb-aa43-7cbeefd81d6d" containerID="e4ef04e900b23bd8b49848c7264303321f0ed8c0de91a1152a1e3db253ec9b3b" exitCode=0
Jul 23 18:18:33.203793 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:33.203447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rllx6" event={"ID":"2a2d4021-244c-4afb-aa43-7cbeefd81d6d","Type":"ContainerDied","Data":"e4ef04e900b23bd8b49848c7264303321f0ed8c0de91a1152a1e3db253ec9b3b"}
Jul 23 18:18:33.203831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:33.203795    2562 scope.go:117] "RemoveContainer" containerID="e4ef04e900b23bd8b49848c7264303321f0ed8c0de91a1152a1e3db253ec9b3b"
Jul 23 18:18:34.209393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:18:34.209362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rllx6" event={"ID":"2a2d4021-244c-4afb-aa43-7cbeefd81d6d","Type":"ContainerStarted","Data":"4f63003d00f42f1b89e995956068f43ca496d31909c44988a012b62b56bb73af"}
Jul 23 18:20:59.291821 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.291785    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"]
Jul 23 18:20:59.292251 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.292058    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerName="registry"
Jul 23 18:20:59.292251 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.292069    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerName="registry"
Jul 23 18:20:59.292251 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.292116    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c141e7-8138-421f-b752-c14c9f5a4ba5" containerName="registry"
Jul 23 18:20:59.294795 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.294778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.297645 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.297620    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 18:20:59.297758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.297650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ws6cv\""
Jul 23 18:20:59.298854 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.298830    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 18:20:59.304041 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.304021    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"]
Jul 23 18:20:59.313300 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.313274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nqpj\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-kube-api-access-5nqpj\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.313387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.313336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.414580 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.414552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.414742 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.414591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nqpj\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-kube-api-access-5nqpj\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.422815 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.422792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nqpj\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-kube-api-access-5nqpj\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.422911 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.422868    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47aaaa69-87ee-4e88-bc45-7e433e7b46ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ll2jb\" (UID: \"47aaaa69-87ee-4e88-bc45-7e433e7b46ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.603660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.603590    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"
Jul 23 18:20:59.724582 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:20:59.724509    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb"]
Jul 23 18:20:59.727039 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:20:59.727009    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47aaaa69_87ee_4e88_bc45_7e433e7b46ac.slice/crio-be2a55c46baad91d0b5db6f6a45f1d3c9618fca5d40c8e9b8097324aa822bb65 WatchSource:0}: Error finding container be2a55c46baad91d0b5db6f6a45f1d3c9618fca5d40c8e9b8097324aa822bb65: Status 404 returned error can't find the container with id be2a55c46baad91d0b5db6f6a45f1d3c9618fca5d40c8e9b8097324aa822bb65
Jul 23 18:21:00.699305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:00.699243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb" event={"ID":"47aaaa69-87ee-4e88-bc45-7e433e7b46ac","Type":"ContainerStarted","Data":"be2a55c46baad91d0b5db6f6a45f1d3c9618fca5d40c8e9b8097324aa822bb65"}
Jul 23 18:21:02.857500 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:02.857451    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:21:03.717766 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:03.717726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb" event={"ID":"47aaaa69-87ee-4e88-bc45-7e433e7b46ac","Type":"ContainerStarted","Data":"249ad9d87c344711ec72276aedd38e5374880facef51d788e743cdcbd3a79061"}
Jul 23 18:21:03.735221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:03.735172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ll2jb" podStartSLOduration=1.563176553 podStartE2EDuration="4.735158613s" totalImagesPullingTime="3.17198206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:21:03.734472493 +0000 UTC m=+302.828117938" watchObservedRunningTime="2026-07-23 18:21:03.735158613 +0000 UTC m=+302.828804030"
Jul 23 18:21:35.389580 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.389531    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"]
Jul 23 18:21:35.393012 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.392984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.399046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.399005    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:21:35.399319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.399275    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:21:35.399319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.399299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:21:35.399319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.399299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-565dp\""
Jul 23 18:21:35.400219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.400200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:21:35.421863 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.421829    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"]
Jul 23 18:21:35.501129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.501087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrm7\" (UniqueName: \"kubernetes.io/projected/dd564a2b-6609-4808-b14f-83b7f2025db0-kube-api-access-bjrm7\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.501305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.501137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.501305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.501192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-manifests\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.501305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.501221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.501305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.501264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-tmp\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602114 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-manifests\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602289 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602289 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-tmp\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602289 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrm7\" (UniqueName: \"kubernetes.io/projected/dd564a2b-6609-4808-b14f-83b7f2025db0-kube-api-access-bjrm7\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602450 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.602585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.602564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-manifests\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.604513 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.604474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd564a2b-6609-4808-b14f-83b7f2025db0-tmp\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.604784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.604768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-webhook-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.604923 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.604905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/dd564a2b-6609-4808-b14f-83b7f2025db0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.610559 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.610465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrm7\" (UniqueName: \"kubernetes.io/projected/dd564a2b-6609-4808-b14f-83b7f2025db0-kube-api-access-bjrm7\") pod \"opendatahub-operator-controller-manager-77bdbd87db-kxt5w\" (UID: \"dd564a2b-6609-4808-b14f-83b7f2025db0\") " pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.703252 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.703159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:35.848895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.848865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"]
Jul 23 18:21:35.852500 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:21:35.852451    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd564a2b_6609_4808_b14f_83b7f2025db0.slice/crio-cb4044f63661280fd6aeb272da437e56026a1c5d57ddfa685dbf51c03f467d8e WatchSource:0}: Error finding container cb4044f63661280fd6aeb272da437e56026a1c5d57ddfa685dbf51c03f467d8e: Status 404 returned error can't find the container with id cb4044f63661280fd6aeb272da437e56026a1c5d57ddfa685dbf51c03f467d8e
Jul 23 18:21:35.854278 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:35.854261    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:21:36.834602 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:36.834539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w" event={"ID":"dd564a2b-6609-4808-b14f-83b7f2025db0","Type":"ContainerStarted","Data":"cb4044f63661280fd6aeb272da437e56026a1c5d57ddfa685dbf51c03f467d8e"}
Jul 23 18:21:39.847619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:39.847582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w" event={"ID":"dd564a2b-6609-4808-b14f-83b7f2025db0","Type":"ContainerStarted","Data":"f76d78c516511cc63e659fabd179d49127b0546119c1f653b10fb3c6f029aca7"}
Jul 23 18:21:40.853106 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:40.853070    2562 generic.go:356] "Generic (PLEG): container finished" podID="dd564a2b-6609-4808-b14f-83b7f2025db0" containerID="f76d78c516511cc63e659fabd179d49127b0546119c1f653b10fb3c6f029aca7" exitCode=0
Jul 23 18:21:40.853501 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:40.853139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w" event={"ID":"dd564a2b-6609-4808-b14f-83b7f2025db0","Type":"ContainerDied","Data":"f76d78c516511cc63e659fabd179d49127b0546119c1f653b10fb3c6f029aca7"}
Jul 23 18:21:41.858761 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:41.858721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w" event={"ID":"dd564a2b-6609-4808-b14f-83b7f2025db0","Type":"ContainerStarted","Data":"badc9a0f5ffbd3a5f075a323d3823ab73acbf674b8d4e7374b85e6a5cebd3cb3"}
Jul 23 18:21:41.859249 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:41.858866    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:41.882046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:41.881990    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w" podStartSLOduration=2.392264608 podStartE2EDuration="6.881973972s" totalImagesPullingTime="3.393779344s" totalInitContainerRuntime="1.09593002s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:21:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:21:41.881453947 +0000 UTC m=+340.975099365" watchObservedRunningTime="2026-07-23 18:21:41.881973972 +0000 UTC m=+340.975619388"
Jul 23 18:21:52.864747 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:52.864714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77bdbd87db-kxt5w"
Jul 23 18:21:55.032390 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.032306    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"]
Jul 23 18:21:55.035433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.035412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.038495 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.038462    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 18:21:55.038984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.038965    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j4n9q\""
Jul 23 18:21:55.039898 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.039880    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:21:55.039898 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.039890    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 18:21:55.040004 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.039911    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:21:55.049420 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.049392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"]
Jul 23 18:21:55.055324 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.055295    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452ffd09-056e-4c77-949e-05d01d585cc1-tmp\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.055442 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.055347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qzgd\" (UniqueName: \"kubernetes.io/projected/452ffd09-056e-4c77-949e-05d01d585cc1-kube-api-access-9qzgd\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.055442 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.055372    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.156118 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.156087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qzgd\" (UniqueName: \"kubernetes.io/projected/452ffd09-056e-4c77-949e-05d01d585cc1-kube-api-access-9qzgd\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.156118 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.156128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.156386 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.156164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452ffd09-056e-4c77-949e-05d01d585cc1-tmp\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.156765 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:21:55.156731    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 23 18:21:55.156877 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:21:55.156841    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs podName:452ffd09-056e-4c77-949e-05d01d585cc1 nodeName:}" failed. No retries permitted until 2026-07-23 18:21:55.656819284 +0000 UTC m=+354.750464682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs") pod "kube-auth-proxy-6b75b7b5f6-gth2l" (UID: "452ffd09-056e-4c77-949e-05d01d585cc1") : secret "kube-auth-proxy-tls" not found
Jul 23 18:21:55.163149 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.163110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/452ffd09-056e-4c77-949e-05d01d585cc1-tmp\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.170831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.170805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qzgd\" (UniqueName: \"kubernetes.io/projected/452ffd09-056e-4c77-949e-05d01d585cc1-kube-api-access-9qzgd\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.298029 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.297940    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pl7d2"]
Jul 23 18:21:55.301275 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.301252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.304047 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.304024    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wpzt8\""
Jul 23 18:21:55.304160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.304045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 18:21:55.319306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.319280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pl7d2"]
Jul 23 18:21:55.357538 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.357504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.357703 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.357548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfq7s\" (UniqueName: \"kubernetes.io/projected/4bd29ab8-15f4-4d12-b778-29856f153d3d-kube-api-access-gfq7s\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.458048 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.458010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.458048 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.458046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfq7s\" (UniqueName: \"kubernetes.io/projected/4bd29ab8-15f4-4d12-b778-29856f153d3d-kube-api-access-gfq7s\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.458301 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:21:55.458166    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 18:21:55.458301 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:21:55.458235    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert podName:4bd29ab8-15f4-4d12-b778-29856f153d3d nodeName:}" failed. No retries permitted until 2026-07-23 18:21:55.958216185 +0000 UTC m=+355.051861592 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert") pod "odh-model-controller-7998c67dc4-pl7d2" (UID: "4bd29ab8-15f4-4d12-b778-29856f153d3d") : secret "odh-model-controller-webhook-cert" not found
Jul 23 18:21:55.468707 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.468677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfq7s\" (UniqueName: \"kubernetes.io/projected/4bd29ab8-15f4-4d12-b778-29856f153d3d-kube-api-access-gfq7s\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.659551 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.659457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.662052 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.662027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/452ffd09-056e-4c77-949e-05d01d585cc1-tls-certs\") pod \"kube-auth-proxy-6b75b7b5f6-gth2l\" (UID: \"452ffd09-056e-4c77-949e-05d01d585cc1\") " pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.944969 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.944881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"
Jul 23 18:21:55.962330 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.962300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:55.964653 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:55.964625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bd29ab8-15f4-4d12-b778-29856f153d3d-cert\") pod \"odh-model-controller-7998c67dc4-pl7d2\" (UID: \"4bd29ab8-15f4-4d12-b778-29856f153d3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:56.084646 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.084611    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l"]
Jul 23 18:21:56.087493 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:21:56.087459    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452ffd09_056e_4c77_949e_05d01d585cc1.slice/crio-21e4bfe33df6675d0b663e64bc099a1e61dc5df9d516146894d02dada38b9c37 WatchSource:0}: Error finding container 21e4bfe33df6675d0b663e64bc099a1e61dc5df9d516146894d02dada38b9c37: Status 404 returned error can't find the container with id 21e4bfe33df6675d0b663e64bc099a1e61dc5df9d516146894d02dada38b9c37
Jul 23 18:21:56.211216 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.211128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:56.307398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.307364    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:21:56.310984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.310962    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.314158 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.314129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 18:21:56.314285 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.314129    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 18:21:56.314389 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.314367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 18:21:56.314470 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.314453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-slksd\""
Jul 23 18:21:56.314679 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.314658    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 18:21:56.323379 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.323276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:21:56.351906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.351880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pl7d2"]
Jul 23 18:21:56.353707 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:21:56.353680    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd29ab8_15f4_4d12_b778_29856f153d3d.slice/crio-45c47a45366029f41993f9dd9ffdb11cc04a03aa9d00bb35770aa9bbcfb3ac51 WatchSource:0}: Error finding container 45c47a45366029f41993f9dd9ffdb11cc04a03aa9d00bb35770aa9bbcfb3ac51: Status 404 returned error can't find the container with id 45c47a45366029f41993f9dd9ffdb11cc04a03aa9d00bb35770aa9bbcfb3ac51
Jul 23 18:21:56.366223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366459 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlwcd\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366459 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.366459 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.366415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467698 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467698 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlwcd\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467698 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467993 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467993 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467993 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.467993 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.467816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.468511 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.468468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.470160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.470118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.470316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.470297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.470572 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.470550    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.470636 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.470623    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.483399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.483378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.484089 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.484069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlwcd\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd\") pod \"istiod-openshift-gateway-7574459656-fbz5q\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.624113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.624074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:21:56.819202 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.819175    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:21:56.821272 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:21:56.821242    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb894486b_d09d_467a_b208_ea93a0c4ffe5.slice/crio-242bc752c9f295188abd59bba313ccaab25811e96433ee3a0c6a2d969622058b WatchSource:0}: Error finding container 242bc752c9f295188abd59bba313ccaab25811e96433ee3a0c6a2d969622058b: Status 404 returned error can't find the container with id 242bc752c9f295188abd59bba313ccaab25811e96433ee3a0c6a2d969622058b
Jul 23 18:21:56.913995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.913953    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2" event={"ID":"4bd29ab8-15f4-4d12-b778-29856f153d3d","Type":"ContainerStarted","Data":"45c47a45366029f41993f9dd9ffdb11cc04a03aa9d00bb35770aa9bbcfb3ac51"}
Jul 23 18:21:56.915346 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.915310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" event={"ID":"b894486b-d09d-467a-b208-ea93a0c4ffe5","Type":"ContainerStarted","Data":"242bc752c9f295188abd59bba313ccaab25811e96433ee3a0c6a2d969622058b"}
Jul 23 18:21:56.916628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:56.916596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l" event={"ID":"452ffd09-056e-4c77-949e-05d01d585cc1","Type":"ContainerStarted","Data":"21e4bfe33df6675d0b663e64bc099a1e61dc5df9d516146894d02dada38b9c37"}
Jul 23 18:21:59.934170 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:59.934069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2" event={"ID":"4bd29ab8-15f4-4d12-b778-29856f153d3d","Type":"ContainerStarted","Data":"1f44bbff180ce599bc1207e4a6157de583972c9f09b18499a6c04566e45a8c5e"}
Jul 23 18:21:59.934170 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:59.934148    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:21:59.935944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:59.935918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l" event={"ID":"452ffd09-056e-4c77-949e-05d01d585cc1","Type":"ContainerStarted","Data":"8f159a5d8c7b855c992e0952a76ff6fb2b132bf8f7324aa54b1b7e7799ea0228"}
Jul 23 18:21:59.957189 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:59.957123    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2" podStartSLOduration=1.631895073 podStartE2EDuration="4.957102745s" totalImagesPullingTime="3.325207672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:21:59.956646583 +0000 UTC m=+359.050292001" watchObservedRunningTime="2026-07-23 18:21:59.957102745 +0000 UTC m=+359.050748163"
Jul 23 18:21:59.976219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:21:59.976156    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b75b7b5f6-gth2l" podStartSLOduration=1.43213641 podStartE2EDuration="4.976132745s" totalImagesPullingTime="3.543996335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:21:59.974163242 +0000 UTC m=+359.067808660" watchObservedRunningTime="2026-07-23 18:21:59.976132745 +0000 UTC m=+359.069778170"
Jul 23 18:22:01.541627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:01.541570    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:22:01.541907 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:01.541655    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:22:01.946379 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:01.946280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" event={"ID":"b894486b-d09d-467a-b208-ea93a0c4ffe5","Type":"ContainerStarted","Data":"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"}
Jul 23 18:22:01.946583 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:01.946432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:22:01.970822 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:01.970758    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" podStartSLOduration=1.2531191 podStartE2EDuration="5.970738346s" totalImagesPullingTime="4.717619246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:22:01.967832629 +0000 UTC m=+361.061478084" watchObservedRunningTime="2026-07-23 18:22:01.970738346 +0000 UTC m=+361.064383764"
Jul 23 18:22:02.953034 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:02.953004    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:22:03.396966 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.396929    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"]
Jul 23 18:22:03.400284 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.400267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428529 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgjj\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-kube-api-access-nfgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.428847 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.428693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.514401 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.514365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"]
Jul 23 18:22:03.529159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgjj\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-kube-api-access-nfgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.529335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.529289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.530191 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.530158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.531795 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.531769    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.531968 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.531867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.532135 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.532116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.532233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.532213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.545592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.545559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.545782 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.545763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgjj\" (UniqueName: \"kubernetes.io/projected/e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61-kube-api-access-nfgjj\") pod \"istiod-openshift-gateway-94bb8fbfd-fp6s2\" (UID: \"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.709518 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.709402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.852221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.852196    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"]
Jul 23 18:22:03.853901 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:22:03.853871    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ea54bb_ebcb_4ddc_9042_c9b88aaeaf61.slice/crio-5b7d310e1545dfbce4f3f63c1d57baf852ee8589286beb3037e0d6c8c36cc607 WatchSource:0}: Error finding container 5b7d310e1545dfbce4f3f63c1d57baf852ee8589286beb3037e0d6c8c36cc607: Status 404 returned error can't find the container with id 5b7d310e1545dfbce4f3f63c1d57baf852ee8589286beb3037e0d6c8c36cc607
Jul 23 18:22:03.856163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.856120    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:22:03.856263 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.856193    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:22:03.959306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.959268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2" event={"ID":"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61","Type":"ContainerStarted","Data":"28a4be96bf6cad1d6d7154a43b17104a330ec860b372ee7e05ecf118f74b1110"}
Jul 23 18:22:03.959835 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.959331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2" event={"ID":"e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61","Type":"ContainerStarted","Data":"5b7d310e1545dfbce4f3f63c1d57baf852ee8589286beb3037e0d6c8c36cc607"}
Jul 23 18:22:03.959835 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.959459    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:03.985763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:03.985694    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2" podStartSLOduration=0.98567122 podStartE2EDuration="985.67122ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:22:03.983788932 +0000 UTC m=+363.077434351" watchObservedRunningTime="2026-07-23 18:22:03.98567122 +0000 UTC m=+363.079316638"
Jul 23 18:22:04.965689 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:04.965654    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fp6s2"
Jul 23 18:22:05.081388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.081355    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:22:05.081569 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.081547    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" podUID="b894486b-d09d-467a-b208-ea93a0c4ffe5" containerName="discovery" containerID="cri-o://0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc" gracePeriod=30
Jul 23 18:22:05.329172 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.329148    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:22:05.346561 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346535    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346691 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346691 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346691 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlwcd\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346691 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346666    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346893 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346712    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.346893 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.346764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts\") pod \"b894486b-d09d-467a-b208-ea93a0c4ffe5\" (UID: \"b894486b-d09d-467a-b208-ea93a0c4ffe5\") "
Jul 23 18:22:05.347137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.347099    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:22:05.348976 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.348925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs" (OuterVolumeSpecName: "local-certs") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:22:05.348976 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.348930    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token" (OuterVolumeSpecName: "istio-token") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:22:05.349140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.349092    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:22:05.349196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.349152    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd" (OuterVolumeSpecName: "kube-api-access-rlwcd") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "kube-api-access-rlwcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:22:05.349269 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.349253    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:22:05.349386 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.349300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts" (OuterVolumeSpecName: "cacerts") pod "b894486b-d09d-467a-b208-ea93a0c4ffe5" (UID: "b894486b-d09d-467a-b208-ea93a0c4ffe5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:22:05.447973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.447943    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.447973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.447971    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-kubeconfig\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.448218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.447983    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-dns-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.448218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.447998    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlwcd\" (UniqueName: \"kubernetes.io/projected/b894486b-d09d-467a-b208-ea93a0c4ffe5-kube-api-access-rlwcd\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.448218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.448009    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b894486b-d09d-467a-b208-ea93a0c4ffe5-local-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.448218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.448020    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b894486b-d09d-467a-b208-ea93a0c4ffe5-istio-csr-ca-configmap\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.448218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.448034    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b894486b-d09d-467a-b208-ea93a0c4ffe5-cacerts\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:22:05.974665 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.974567    2562 generic.go:356] "Generic (PLEG): container finished" podID="b894486b-d09d-467a-b208-ea93a0c4ffe5" containerID="0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc" exitCode=0
Jul 23 18:22:05.974665 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.974623    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"
Jul 23 18:22:05.974665 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.974644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" event={"ID":"b894486b-d09d-467a-b208-ea93a0c4ffe5","Type":"ContainerDied","Data":"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"}
Jul 23 18:22:05.975177 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.974716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q" event={"ID":"b894486b-d09d-467a-b208-ea93a0c4ffe5","Type":"ContainerDied","Data":"242bc752c9f295188abd59bba313ccaab25811e96433ee3a0c6a2d969622058b"}
Jul 23 18:22:05.975177 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.974738    2562 scope.go:117] "RemoveContainer" containerID="0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"
Jul 23 18:22:05.983210 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.983194    2562 scope.go:117] "RemoveContainer" containerID="0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"
Jul 23 18:22:05.983516 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:22:05.983493    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc\": container with ID starting with 0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc not found: ID does not exist" containerID="0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"
Jul 23 18:22:05.983601 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:05.983523    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc"} err="failed to get container status \"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc\": rpc error: code = NotFound desc = could not find container \"0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc\": container with ID starting with 0c68a69e49998bff877cbc13f63b42d858b04475c6e43f7d095cdc6bbfe07bbc not found: ID does not exist"
Jul 23 18:22:06.015200 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.015159    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:22:06.023348 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.023316    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-fbz5q"]
Jul 23 18:22:06.258784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.258701    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klssh"]
Jul 23 18:22:06.259003 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.258988    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b894486b-d09d-467a-b208-ea93a0c4ffe5" containerName="discovery"
Jul 23 18:22:06.259003 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.259001    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b894486b-d09d-467a-b208-ea93a0c4ffe5" containerName="discovery"
Jul 23 18:22:06.259133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.259058    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b894486b-d09d-467a-b208-ea93a0c4ffe5" containerName="discovery"
Jul 23 18:22:06.263059 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.263033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.265727 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.265707    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 18:22:06.266368 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.266341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cjwmh\""
Jul 23 18:22:06.272753 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.272732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klssh"]
Jul 23 18:22:06.364950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.362870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55447e88-9a6f-45b9-a95c-71a434c8b171-cert\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.364950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.362925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb6n6\" (UniqueName: \"kubernetes.io/projected/55447e88-9a6f-45b9-a95c-71a434c8b171-kube-api-access-xb6n6\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.463535 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.463502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55447e88-9a6f-45b9-a95c-71a434c8b171-cert\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.463535 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.463538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb6n6\" (UniqueName: \"kubernetes.io/projected/55447e88-9a6f-45b9-a95c-71a434c8b171-kube-api-access-xb6n6\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.466234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.466194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55447e88-9a6f-45b9-a95c-71a434c8b171-cert\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.482739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.482702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb6n6\" (UniqueName: \"kubernetes.io/projected/55447e88-9a6f-45b9-a95c-71a434c8b171-kube-api-access-xb6n6\") pod \"kserve-controller-manager-d6f4b65b8-klssh\" (UID: \"55447e88-9a6f-45b9-a95c-71a434c8b171\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.575245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.575201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:06.717845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.717821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-klssh"]
Jul 23 18:22:06.720116 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:22:06.720086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55447e88_9a6f_45b9_a95c_71a434c8b171.slice/crio-7aec9b2b32bcaee62c31583f6ac0f29f5da0be5d07141a7323f42d11be3b4c43 WatchSource:0}: Error finding container 7aec9b2b32bcaee62c31583f6ac0f29f5da0be5d07141a7323f42d11be3b4c43: Status 404 returned error can't find the container with id 7aec9b2b32bcaee62c31583f6ac0f29f5da0be5d07141a7323f42d11be3b4c43
Jul 23 18:22:06.980553 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:06.980443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh" event={"ID":"55447e88-9a6f-45b9-a95c-71a434c8b171","Type":"ContainerStarted","Data":"7aec9b2b32bcaee62c31583f6ac0f29f5da0be5d07141a7323f42d11be3b4c43"}
Jul 23 18:22:07.576680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:07.576648    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b894486b-d09d-467a-b208-ea93a0c4ffe5" path="/var/lib/kubelet/pods/b894486b-d09d-467a-b208-ea93a0c4ffe5/volumes"
Jul 23 18:22:09.996322 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:09.996235    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh" event={"ID":"55447e88-9a6f-45b9-a95c-71a434c8b171","Type":"ContainerStarted","Data":"a5b43e32f9360b6c8cd4c54ea6c169f013e86496192769e0a3e9c4e85eb8f404"}
Jul 23 18:22:09.996758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:09.996382    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:10.014444 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:10.014374    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh" podStartSLOduration=1.103205485 podStartE2EDuration="4.014358011s" totalImagesPullingTime="2.911152526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:22:10.012972788 +0000 UTC m=+369.106618206" watchObservedRunningTime="2026-07-23 18:22:10.014358011 +0000 UTC m=+369.108003427"
Jul 23 18:22:10.943492 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:10.943443    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pl7d2"
Jul 23 18:22:41.006109 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:41.006075    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-klssh"
Jul 23 18:22:56.089117 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.089075    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:22:56.092363 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.092341    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:56.096975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.096950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8zxxq\""
Jul 23 18:22:56.097112 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.096954    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:22:56.098119 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.098098    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:22:56.103660 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.103632    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:22:56.184047 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.184010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk7lj\" (UniqueName: \"kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj\") pod \"kuadrant-operator-catalog-nfnhf\" (UID: \"5f53beee-ed04-40d4-81ac-5ff5552fec64\") " pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:56.284652 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.284615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk7lj\" (UniqueName: \"kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj\") pod \"kuadrant-operator-catalog-nfnhf\" (UID: \"5f53beee-ed04-40d4-81ac-5ff5552fec64\") " pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:56.302784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.302754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk7lj\" (UniqueName: \"kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj\") pod \"kuadrant-operator-catalog-nfnhf\" (UID: \"5f53beee-ed04-40d4-81ac-5ff5552fec64\") " pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:56.403298 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.403197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:56.460852 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.460822    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:22:56.540692 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.540663    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:22:56.542880 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:22:56.542850    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f53beee_ed04_40d4_81ac_5ff5552fec64.slice/crio-c4cf4f1be8fee763d7cafacd36f4d2ec45496faa90e2a11ce3a9abbbfa8c13ee WatchSource:0}: Error finding container c4cf4f1be8fee763d7cafacd36f4d2ec45496faa90e2a11ce3a9abbbfa8c13ee: Status 404 returned error can't find the container with id c4cf4f1be8fee763d7cafacd36f4d2ec45496faa90e2a11ce3a9abbbfa8c13ee
Jul 23 18:22:56.673399 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.673322    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skq5n"]
Jul 23 18:22:56.677624 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.677605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:22:56.685024 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.684998    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skq5n"]
Jul 23 18:22:56.789348 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.789311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nphn\" (UniqueName: \"kubernetes.io/projected/3f284554-6e7c-4a6d-ad09-355e03033c58-kube-api-access-8nphn\") pod \"kuadrant-operator-catalog-skq5n\" (UID: \"3f284554-6e7c-4a6d-ad09-355e03033c58\") " pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:22:56.890058 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.890025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nphn\" (UniqueName: \"kubernetes.io/projected/3f284554-6e7c-4a6d-ad09-355e03033c58-kube-api-access-8nphn\") pod \"kuadrant-operator-catalog-skq5n\" (UID: \"3f284554-6e7c-4a6d-ad09-355e03033c58\") " pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:22:56.898643 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.898615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nphn\" (UniqueName: \"kubernetes.io/projected/3f284554-6e7c-4a6d-ad09-355e03033c58-kube-api-access-8nphn\") pod \"kuadrant-operator-catalog-skq5n\" (UID: \"3f284554-6e7c-4a6d-ad09-355e03033c58\") " pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:22:56.988078 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:56.987983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:22:57.134467 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:57.134440    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skq5n"]
Jul 23 18:22:57.136662 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:22:57.136634    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f284554_6e7c_4a6d_ad09_355e03033c58.slice/crio-3cc4e60a1f7f0ab299f3e817d6b906dc6f5ef86cdc52bbe312c8790fbb5ad943 WatchSource:0}: Error finding container 3cc4e60a1f7f0ab299f3e817d6b906dc6f5ef86cdc52bbe312c8790fbb5ad943: Status 404 returned error can't find the container with id 3cc4e60a1f7f0ab299f3e817d6b906dc6f5ef86cdc52bbe312c8790fbb5ad943
Jul 23 18:22:57.192614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:57.192575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" event={"ID":"5f53beee-ed04-40d4-81ac-5ff5552fec64","Type":"ContainerStarted","Data":"c4cf4f1be8fee763d7cafacd36f4d2ec45496faa90e2a11ce3a9abbbfa8c13ee"}
Jul 23 18:22:57.193719 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:57.193692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skq5n" event={"ID":"3f284554-6e7c-4a6d-ad09-355e03033c58","Type":"ContainerStarted","Data":"3cc4e60a1f7f0ab299f3e817d6b906dc6f5ef86cdc52bbe312c8790fbb5ad943"}
Jul 23 18:22:59.203089 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.202980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skq5n" event={"ID":"3f284554-6e7c-4a6d-ad09-355e03033c58","Type":"ContainerStarted","Data":"0c8f84b4b0aef9887f170d13685f264a9e1255da5810179c96921120f680435b"}
Jul 23 18:22:59.204424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.204397    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" event={"ID":"5f53beee-ed04-40d4-81ac-5ff5552fec64","Type":"ContainerStarted","Data":"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"}
Jul 23 18:22:59.204547 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.204515    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" podUID="5f53beee-ed04-40d4-81ac-5ff5552fec64" containerName="registry-server" containerID="cri-o://13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46" gracePeriod=2
Jul 23 18:22:59.219050 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.219009    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-skq5n" podStartSLOduration=1.581165588 podStartE2EDuration="3.218991616s" totalImagesPullingTime="1.637826028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:22:59.21820472 +0000 UTC m=+418.311850138" watchObservedRunningTime="2026-07-23 18:22:59.218991616 +0000 UTC m=+418.312637034"
Jul 23 18:22:59.234094 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.234043    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" podStartSLOduration=1.001975198 podStartE2EDuration="3.234026136s" totalImagesPullingTime="2.232050938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:22:59.233202336 +0000 UTC m=+418.326847755" watchObservedRunningTime="2026-07-23 18:22:59.234026136 +0000 UTC m=+418.327671553"
Jul 23 18:22:59.446305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.446278    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:22:59.510902 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.510804    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk7lj\" (UniqueName: \"kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj\") pod \"5f53beee-ed04-40d4-81ac-5ff5552fec64\" (UID: \"5f53beee-ed04-40d4-81ac-5ff5552fec64\") "
Jul 23 18:22:59.512974 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.512950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj" (OuterVolumeSpecName: "kube-api-access-nk7lj") pod "5f53beee-ed04-40d4-81ac-5ff5552fec64" (UID: "5f53beee-ed04-40d4-81ac-5ff5552fec64"). InnerVolumeSpecName "kube-api-access-nk7lj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:22:59.611393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:22:59.611365    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk7lj\" (UniqueName: \"kubernetes.io/projected/5f53beee-ed04-40d4-81ac-5ff5552fec64-kube-api-access-nk7lj\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:00.210600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.210505    2562 generic.go:356] "Generic (PLEG): container finished" podID="5f53beee-ed04-40d4-81ac-5ff5552fec64" containerID="13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46" exitCode=0
Jul 23 18:23:00.210600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.210546    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf"
Jul 23 18:23:00.210600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.210584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" event={"ID":"5f53beee-ed04-40d4-81ac-5ff5552fec64","Type":"ContainerDied","Data":"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"}
Jul 23 18:23:00.211111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.210635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nfnhf" event={"ID":"5f53beee-ed04-40d4-81ac-5ff5552fec64","Type":"ContainerDied","Data":"c4cf4f1be8fee763d7cafacd36f4d2ec45496faa90e2a11ce3a9abbbfa8c13ee"}
Jul 23 18:23:00.211111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.210658    2562 scope.go:117] "RemoveContainer" containerID="13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"
Jul 23 18:23:00.219374 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.219351    2562 scope.go:117] "RemoveContainer" containerID="13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"
Jul 23 18:23:00.219709 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:00.219688    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46\": container with ID starting with 13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46 not found: ID does not exist" containerID="13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"
Jul 23 18:23:00.219765 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.219718    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46"} err="failed to get container status \"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46\": rpc error: code = NotFound desc = could not find container \"13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46\": container with ID starting with 13c6122f81095f6d8b1dc7d85c4723dd856e75db71dd47782e6726c41e75bf46 not found: ID does not exist"
Jul 23 18:23:00.227881 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.227856    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:23:00.231728 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:00.231706    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nfnhf"]
Jul 23 18:23:01.579895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:01.579819    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f53beee-ed04-40d4-81ac-5ff5552fec64" path="/var/lib/kubelet/pods/5f53beee-ed04-40d4-81ac-5ff5552fec64/volumes"
Jul 23 18:23:06.988500 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:06.988419    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:23:06.988500 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:06.988513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:23:07.010895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:07.010866    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:23:07.261721 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:07.261642    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-skq5n"
Jul 23 18:23:24.153334 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.153254    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"]
Jul 23 18:23:24.153853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.153627    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f53beee-ed04-40d4-81ac-5ff5552fec64" containerName="registry-server"
Jul 23 18:23:24.153853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.153641    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f53beee-ed04-40d4-81ac-5ff5552fec64" containerName="registry-server"
Jul 23 18:23:24.153853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.153707    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f53beee-ed04-40d4-81ac-5ff5552fec64" containerName="registry-server"
Jul 23 18:23:24.156507 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.156474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.159556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.159533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4xfhr\""
Jul 23 18:23:24.168803 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.168775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"]
Jul 23 18:23:24.329704 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.329663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.329890 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.329713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2htx\" (UniqueName: \"kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.431288 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.431189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.431288 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.431239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2htx\" (UniqueName: \"kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.431705 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.431684    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.441566 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.441548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2htx\" (UniqueName: \"kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.466582 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.466547    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:24.606112 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:24.606089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"]
Jul 23 18:23:24.608790 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:23:24.608763    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa08317_6547_45c7_beed_4d6d2dfef6e4.slice/crio-642fb21aa04a601ac53ac61263d6dc57b5143c0e74dd6550348457647d796e28 WatchSource:0}: Error finding container 642fb21aa04a601ac53ac61263d6dc57b5143c0e74dd6550348457647d796e28: Status 404 returned error can't find the container with id 642fb21aa04a601ac53ac61263d6dc57b5143c0e74dd6550348457647d796e28
Jul 23 18:23:25.312265 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:25.312230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642" event={"ID":"9aa08317-6547-45c7-beed-4d6d2dfef6e4","Type":"ContainerStarted","Data":"642fb21aa04a601ac53ac61263d6dc57b5143c0e74dd6550348457647d796e28"}
Jul 23 18:23:26.063530 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.063494    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"]
Jul 23 18:23:26.067415 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.067392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:26.072107 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.072082    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m5snv\""
Jul 23 18:23:26.084804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.084775    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"]
Jul 23 18:23:26.246065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.246023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdv5k\" (UniqueName: \"kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k\") pod \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" (UID: \"90108425-8c8c-4ee8-a2e3-6dbe7f799be7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:26.346825 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.346727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdv5k\" (UniqueName: \"kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k\") pod \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" (UID: \"90108425-8c8c-4ee8-a2e3-6dbe7f799be7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:26.359465 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.359424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdv5k\" (UniqueName: \"kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k\") pod \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" (UID: \"90108425-8c8c-4ee8-a2e3-6dbe7f799be7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:26.381163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.381131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:26.537530 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:26.537442    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"]
Jul 23 18:23:26.539903 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:23:26.539879    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90108425_8c8c_4ee8_a2e3_6dbe7f799be7.slice/crio-83b395bc263eea6e6c514b80e133703a6e8933f5090e0cac54a0fc37e2ffcfaf WatchSource:0}: Error finding container 83b395bc263eea6e6c514b80e133703a6e8933f5090e0cac54a0fc37e2ffcfaf: Status 404 returned error can't find the container with id 83b395bc263eea6e6c514b80e133703a6e8933f5090e0cac54a0fc37e2ffcfaf
Jul 23 18:23:27.324778 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:27.324739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv" event={"ID":"90108425-8c8c-4ee8-a2e3-6dbe7f799be7","Type":"ContainerStarted","Data":"83b395bc263eea6e6c514b80e133703a6e8933f5090e0cac54a0fc37e2ffcfaf"}
Jul 23 18:23:28.332568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:28.332526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv" event={"ID":"90108425-8c8c-4ee8-a2e3-6dbe7f799be7","Type":"ContainerStarted","Data":"f16cdd9b8ffd6ce1328090c12d7a9febc8730e8c17d4e775f6a9448f5caa7468"}
Jul 23 18:23:28.332935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:28.332663    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:28.353232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:28.353174    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv" podStartSLOduration=0.701983723 podStartE2EDuration="2.353156971s" totalImagesPullingTime="1.651173248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:23:28.351364922 +0000 UTC m=+447.445010339" watchObservedRunningTime="2026-07-23 18:23:28.353156971 +0000 UTC m=+447.446802388"
Jul 23 18:23:30.343893 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:30.343861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642" event={"ID":"9aa08317-6547-45c7-beed-4d6d2dfef6e4","Type":"ContainerStarted","Data":"21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078"}
Jul 23 18:23:30.344319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:30.344090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:30.370434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:30.370382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642" podStartSLOduration=0.808283806 podStartE2EDuration="6.370364675s" totalImagesPullingTime="5.562080869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:23:30.368929352 +0000 UTC m=+449.462574807" watchObservedRunningTime="2026-07-23 18:23:30.370364675 +0000 UTC m=+449.464010093"
Jul 23 18:23:39.340404 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:39.340368    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:41.350087 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:41.350053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.079790 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.079751    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"]
Jul 23 18:23:43.085966 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.085943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.115864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.115825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"]
Jul 23 18:23:43.117503 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.117462    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"]
Jul 23 18:23:43.117682 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.117659    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" containerName="manager" containerID="cri-o://21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078" gracePeriod=2
Jul 23 18:23:43.139418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.139383    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"]
Jul 23 18:23:43.155560 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.155520    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.181037 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.180996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdzkx\" (UniqueName: \"kubernetes.io/projected/df505c07-cef3-4a26-92b7-b3166be54c95-kube-api-access-tdzkx\") pod \"kuadrant-operator-controller-manager-86878c769f-88sbq\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.181220 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.181046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-88sbq\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.183652 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.183620    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:43.184122 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.184107    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" containerName="manager"
Jul 23 18:23:43.184205 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.184126    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" containerName="manager"
Jul 23 18:23:43.184239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.184219    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" containerName="manager"
Jul 23 18:23:43.187937 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.187918    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.198637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.198612    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"]
Jul 23 18:23:43.198871 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.198851    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-tdzkx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq" podUID="df505c07-cef3-4a26-92b7-b3166be54c95"
Jul 23 18:23:43.209300 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.209271    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:43.213402 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.213375    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"]
Jul 23 18:23:43.235017 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.234987    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"]
Jul 23 18:23:43.235215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.235195    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" containerName="manager" containerID="cri-o://f16cdd9b8ffd6ce1328090c12d7a9febc8730e8c17d4e775f6a9448f5caa7468" gracePeriod=2
Jul 23 18:23:43.239639 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.239608    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.244883 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.244846    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.262352 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.262301    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"]
Jul 23 18:23:43.264547 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.264518    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:23:43.265002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.264985    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" containerName="manager"
Jul 23 18:23:43.265052 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.265008    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" containerName="manager"
Jul 23 18:23:43.265113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.265102    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" containerName="manager"
Jul 23 18:23:43.268671 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.268652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.271463 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.271431    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.274136 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.274089    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.281950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.281923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.282067 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.282006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdzkx\" (UniqueName: \"kubernetes.io/projected/df505c07-cef3-4a26-92b7-b3166be54c95-kube-api-access-tdzkx\") pod \"kuadrant-operator-controller-manager-86878c769f-88sbq\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.282067 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.282041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-88sbq\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.282174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.282121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4vg7\" (UniqueName: \"kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.282550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.282524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-88sbq\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.288421 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.288392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:23:43.288557 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.288424    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tdzkx for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-88sbq" not found
Jul 23 18:23:43.288628 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.288583    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/df505c07-cef3-4a26-92b7-b3166be54c95-kube-api-access-tdzkx podName:df505c07-cef3-4a26-92b7-b3166be54c95 nodeName:}" failed. No retries permitted until 2026-07-23 18:23:43.788560753 +0000 UTC m=+462.882206149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tdzkx" (UniqueName: "kubernetes.io/projected/df505c07-cef3-4a26-92b7-b3166be54c95-kube-api-access-tdzkx") pod "kuadrant-operator-controller-manager-86878c769f-88sbq" (UID: "df505c07-cef3-4a26-92b7-b3166be54c95") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-88sbq" not found
Jul 23 18:23:43.382807 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.382771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.383081 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.382817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4vg7\" (UniqueName: \"kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.383081 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.382869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.383081 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.382962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5lp\" (UniqueName: \"kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.383271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.383165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.400147 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.400111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4vg7\" (UniqueName: \"kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7\") pod \"kuadrant-operator-controller-manager-86878c769f-8p45j\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.404193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.404167    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.405158 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.405127    2562 generic.go:356] "Generic (PLEG): container finished" podID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" containerID="21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078" exitCode=0
Jul 23 18:23:43.405274 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.405192    2562 scope.go:117] "RemoveContainer" containerID="21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078"
Jul 23 18:23:43.406797 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.406772    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.407332 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.407312    2562 generic.go:356] "Generic (PLEG): container finished" podID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" containerID="f16cdd9b8ffd6ce1328090c12d7a9febc8730e8c17d4e775f6a9448f5caa7468" exitCode=0
Jul 23 18:23:43.407441 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.407391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.409042 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.409018    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.411344 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.411312    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-88sbq\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="df505c07-cef3-4a26-92b7-b3166be54c95" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.413918 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.413889    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.415138 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.415119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.415348 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.415327    2562 scope.go:117] "RemoveContainer" containerID="21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078"
Jul 23 18:23:43.415711 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.415653    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078\": container with ID starting with 21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078 not found: ID does not exist" containerID="21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078"
Jul 23 18:23:43.415711 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.415693    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078"} err="failed to get container status \"21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078\": rpc error: code = NotFound desc = could not find container \"21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078\": container with ID starting with 21b5f26f9808d0184cc55e78ae6b9be940377502edec668104203b26cd28d078 not found: ID does not exist"
Jul 23 18:23:43.416209 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.416185    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.418571 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.418546    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.420738 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.420714    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.422891 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.422867    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-88sbq\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="df505c07-cef3-4a26-92b7-b3166be54c95" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.483286 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2htx\" (UniqueName: \"kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx\") pod \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") "
Jul 23 18:23:43.483432 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume\") pod \"df505c07-cef3-4a26-92b7-b3166be54c95\" (UID: \"df505c07-cef3-4a26-92b7-b3166be54c95\") "
Jul 23 18:23:43.483432 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume\") pod \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\" (UID: \"9aa08317-6547-45c7-beed-4d6d2dfef6e4\") "
Jul 23 18:23:43.483586 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5lp\" (UniqueName: \"kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.483668 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.483787 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483684    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "df505c07-cef3-4a26-92b7-b3166be54c95" (UID: "df505c07-cef3-4a26-92b7-b3166be54c95"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:23:43.483787 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483750    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdzkx\" (UniqueName: \"kubernetes.io/projected/df505c07-cef3-4a26-92b7-b3166be54c95-kube-api-access-tdzkx\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:43.483787 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483767    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/df505c07-cef3-4a26-92b7-b3166be54c95-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:43.484006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.483986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.484132 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.484104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9aa08317-6547-45c7-beed-4d6d2dfef6e4" (UID: "9aa08317-6547-45c7-beed-4d6d2dfef6e4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:23:43.485359 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.485339    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx" (OuterVolumeSpecName: "kube-api-access-z2htx") pod "9aa08317-6547-45c7-beed-4d6d2dfef6e4" (UID: "9aa08317-6547-45c7-beed-4d6d2dfef6e4"). InnerVolumeSpecName "kube-api-access-z2htx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:23:43.487688 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.487670    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.492858 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.492840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5lp\" (UniqueName: \"kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-m4rsg\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.493003 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.492983    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-88sbq\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="df505c07-cef3-4a26-92b7-b3166be54c95" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:43.496129 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.496107    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-2b642\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:43.498583 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:43.498555    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptrsv\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:43.498638 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.498607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:43.575084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.575050    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa08317-6547-45c7-beed-4d6d2dfef6e4" path="/var/lib/kubelet/pods/9aa08317-6547-45c7-beed-4d6d2dfef6e4/volumes"
Jul 23 18:23:43.575560 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.575539    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df505c07-cef3-4a26-92b7-b3166be54c95" path="/var/lib/kubelet/pods/df505c07-cef3-4a26-92b7-b3166be54c95/volumes"
Jul 23 18:23:43.584141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.584112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdv5k\" (UniqueName: \"kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k\") pod \"90108425-8c8c-4ee8-a2e3-6dbe7f799be7\" (UID: \"90108425-8c8c-4ee8-a2e3-6dbe7f799be7\") "
Jul 23 18:23:43.584588 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.584561    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2htx\" (UniqueName: \"kubernetes.io/projected/9aa08317-6547-45c7-beed-4d6d2dfef6e4-kube-api-access-z2htx\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:43.584804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.584594    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9aa08317-6547-45c7-beed-4d6d2dfef6e4-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:43.588663 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.588637    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k" (OuterVolumeSpecName: "kube-api-access-zdv5k") pod "90108425-8c8c-4ee8-a2e3-6dbe7f799be7" (UID: "90108425-8c8c-4ee8-a2e3-6dbe7f799be7"). InnerVolumeSpecName "kube-api-access-zdv5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:23:43.608871 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.608792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:43.647701 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.647667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:43.651834 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:23:43.651806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7460bd_3e0b_413f_8adc_38d75580d505.slice/crio-a3c1270323510b95db22790090f316f2b6305a944ce12fa5b8a4e8fe0382cdf2 WatchSource:0}: Error finding container a3c1270323510b95db22790090f316f2b6305a944ce12fa5b8a4e8fe0382cdf2: Status 404 returned error can't find the container with id a3c1270323510b95db22790090f316f2b6305a944ce12fa5b8a4e8fe0382cdf2
Jul 23 18:23:43.685421 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.685391    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdv5k\" (UniqueName: \"kubernetes.io/projected/90108425-8c8c-4ee8-a2e3-6dbe7f799be7-kube-api-access-zdv5k\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:43.747581 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:43.747556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:23:43.750338 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:23:43.750304    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67a59b68_0721_4ae2_9897_5f921ba3a73f.slice/crio-f937f029a8c86224b8df3cbca04e15eb6777b5dd4ce7832485302222d2d3345d WatchSource:0}: Error finding container f937f029a8c86224b8df3cbca04e15eb6777b5dd4ce7832485302222d2d3345d: Status 404 returned error can't find the container with id f937f029a8c86224b8df3cbca04e15eb6777b5dd4ce7832485302222d2d3345d
Jul 23 18:23:44.413025 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.412940    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2b642"
Jul 23 18:23:44.414759 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.414721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" event={"ID":"ff7460bd-3e0b-413f-8adc-38d75580d505","Type":"ContainerStarted","Data":"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"}
Jul 23 18:23:44.414894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.414789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" event={"ID":"ff7460bd-3e0b-413f-8adc-38d75580d505","Type":"ContainerStarted","Data":"a3c1270323510b95db22790090f316f2b6305a944ce12fa5b8a4e8fe0382cdf2"}
Jul 23 18:23:44.414894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.414839    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:44.416105 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.416084    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptrsv"
Jul 23 18:23:44.416229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.416108    2562 scope.go:117] "RemoveContainer" containerID="f16cdd9b8ffd6ce1328090c12d7a9febc8730e8c17d4e775f6a9448f5caa7468"
Jul 23 18:23:44.417871 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.417846    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:44.417961 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.417876    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" event={"ID":"67a59b68-0721-4ae2-9897-5f921ba3a73f","Type":"ContainerStarted","Data":"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"}
Jul 23 18:23:44.417961 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.417916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:44.417961 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.417942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" event={"ID":"67a59b68-0721-4ae2-9897-5f921ba3a73f","Type":"ContainerStarted","Data":"f937f029a8c86224b8df3cbca04e15eb6777b5dd4ce7832485302222d2d3345d"}
Jul 23 18:23:44.437761 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.437718    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" podStartSLOduration=1.43770143 podStartE2EDuration="1.43770143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:23:44.436614778 +0000 UTC m=+463.530260196" watchObservedRunningTime="2026-07-23 18:23:44.43770143 +0000 UTC m=+463.531346849"
Jul 23 18:23:44.443704 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:44.439260    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-88sbq\" is forbidden: User \"system:node:ip-10-0-137-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-146.ec2.internal' and this object" podUID="df505c07-cef3-4a26-92b7-b3166be54c95" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-88sbq"
Jul 23 18:23:44.460822 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:44.460774    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" podStartSLOduration=1.4607582639999999 podStartE2EDuration="1.460758264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:23:44.459725876 +0000 UTC m=+463.553371290" watchObservedRunningTime="2026-07-23 18:23:44.460758264 +0000 UTC m=+463.554403681"
Jul 23 18:23:45.574383 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:45.574349    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90108425-8c8c-4ee8-a2e3-6dbe7f799be7" path="/var/lib/kubelet/pods/90108425-8c8c-4ee8-a2e3-6dbe7f799be7/volumes"
Jul 23 18:23:55.425888 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.425856    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:23:55.426339 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.425924    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:55.511920 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.511884    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:55.512156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.512111    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" podUID="ff7460bd-3e0b-413f-8adc-38d75580d505" containerName="manager" containerID="cri-o://cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f" gracePeriod=10
Jul 23 18:23:55.763766 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.763738    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:55.894813 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.894781    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn5lp\" (UniqueName: \"kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp\") pod \"ff7460bd-3e0b-413f-8adc-38d75580d505\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") "
Jul 23 18:23:55.895008 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.894856    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume\") pod \"ff7460bd-3e0b-413f-8adc-38d75580d505\" (UID: \"ff7460bd-3e0b-413f-8adc-38d75580d505\") "
Jul 23 18:23:55.895262 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.895226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ff7460bd-3e0b-413f-8adc-38d75580d505" (UID: "ff7460bd-3e0b-413f-8adc-38d75580d505"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:23:55.897137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.897112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp" (OuterVolumeSpecName: "kube-api-access-vn5lp") pod "ff7460bd-3e0b-413f-8adc-38d75580d505" (UID: "ff7460bd-3e0b-413f-8adc-38d75580d505"). InnerVolumeSpecName "kube-api-access-vn5lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:23:55.996160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.996071    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5lp\" (UniqueName: \"kubernetes.io/projected/ff7460bd-3e0b-413f-8adc-38d75580d505-kube-api-access-vn5lp\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:55.996160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:55.996104    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff7460bd-3e0b-413f-8adc-38d75580d505-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:23:56.472182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.472146    2562 generic.go:356] "Generic (PLEG): container finished" podID="ff7460bd-3e0b-413f-8adc-38d75580d505" containerID="cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f" exitCode=0
Jul 23 18:23:56.472614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.472195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"
Jul 23 18:23:56.472614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.472237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" event={"ID":"ff7460bd-3e0b-413f-8adc-38d75580d505","Type":"ContainerDied","Data":"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"}
Jul 23 18:23:56.472614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.472315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg" event={"ID":"ff7460bd-3e0b-413f-8adc-38d75580d505","Type":"ContainerDied","Data":"a3c1270323510b95db22790090f316f2b6305a944ce12fa5b8a4e8fe0382cdf2"}
Jul 23 18:23:56.472614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.472338    2562 scope.go:117] "RemoveContainer" containerID="cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"
Jul 23 18:23:56.480913 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.480894    2562 scope.go:117] "RemoveContainer" containerID="cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"
Jul 23 18:23:56.481185 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:23:56.481167    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f\": container with ID starting with cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f not found: ID does not exist" containerID="cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"
Jul 23 18:23:56.481253 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.481198    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f"} err="failed to get container status \"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f\": rpc error: code = NotFound desc = could not find container \"cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f\": container with ID starting with cd11d629807ccc70e4b0d7194facd92414817956700984ab71ac583092b1ea0f not found: ID does not exist"
Jul 23 18:23:56.510532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.510501    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:56.524490 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:56.524457    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-m4rsg"]
Jul 23 18:23:57.574200 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:23:57.574165    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7460bd-3e0b-413f-8adc-38d75580d505" path="/var/lib/kubelet/pods/ff7460bd-3e0b-413f-8adc-38d75580d505/volumes"
Jul 23 18:24:11.935264 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.935218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"]
Jul 23 18:24:11.935726 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.935696    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7460bd-3e0b-413f-8adc-38d75580d505" containerName="manager"
Jul 23 18:24:11.935726 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.935717    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7460bd-3e0b-413f-8adc-38d75580d505" containerName="manager"
Jul 23 18:24:11.935951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.935829    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7460bd-3e0b-413f-8adc-38d75580d505" containerName="manager"
Jul 23 18:24:11.938619 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.938595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:11.941918 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.941902    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2rnhw\""
Jul 23 18:24:11.963684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:11.958611    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"]
Jul 23 18:24:12.038514 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qqhj\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-kube-api-access-7qqhj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.038958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.038832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140053 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140053 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qqhj\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-kube-api-access-7qqhj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140669 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140669 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.140954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.140876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.141051 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.141030    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.142995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.142968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.143235 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.143212    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.149801 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.149777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qqhj\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-kube-api-access-7qqhj\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.149894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.149833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68bd3d8b-4b74-4ba0-ad51-66750a9dc68e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-hgtjt\" (UID: \"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.249156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.249063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:12.420784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.420758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"]
Jul 23 18:24:12.423705 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:24:12.423677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bd3d8b_4b74_4ba0_ad51_66750a9dc68e.slice/crio-79d22028d36e2f59673877ed87b48e5cf1e5ee45cd5c92828f3bc655ea17f470 WatchSource:0}: Error finding container 79d22028d36e2f59673877ed87b48e5cf1e5ee45cd5c92828f3bc655ea17f470: Status 404 returned error can't find the container with id 79d22028d36e2f59673877ed87b48e5cf1e5ee45cd5c92828f3bc655ea17f470
Jul 23 18:24:12.545976 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:12.545939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" event={"ID":"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e","Type":"ContainerStarted","Data":"79d22028d36e2f59673877ed87b48e5cf1e5ee45cd5c92828f3bc655ea17f470"}
Jul 23 18:24:15.381233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:15.381191    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:15.381536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:15.381267    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:15.381536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:15.381299    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:24:15.564497 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:15.564429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" event={"ID":"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e","Type":"ContainerStarted","Data":"0440ef882586f6cf74f6814e8c2ab85003a703f9af4df26040b300ad76df20ef"}
Jul 23 18:24:15.609327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:15.609256    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" podStartSLOduration=1.6540171259999998 podStartE2EDuration="4.609234978s" totalImagesPullingTime="2.955217852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:15.606970448 +0000 UTC m=+494.700615876" watchObservedRunningTime="2026-07-23 18:24:15.609234978 +0000 UTC m=+494.702880396"
Jul 23 18:24:16.250293 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.250255    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:16.255103 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.255071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:16.569365 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.569332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:16.570257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.570236    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:24:16.715504 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.715457    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:16.718831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.718810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.723845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.723818    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 18:24:16.724010 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.723957    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w6tlp\""
Jul 23 18:24:16.795306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.795270    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:16.812012 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.811982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:16.881673 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.881581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.881673 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.881630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwlxf\" (UniqueName: \"kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.982367 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.982325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwlxf\" (UniqueName: \"kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.982609 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.982445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.983128 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.983108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:16.991235 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:16.991207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwlxf\" (UniqueName: \"kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf\") pod \"limitador-limitador-64c94fd64f-gq2jj\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:17.030705 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:17.030673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:17.171226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:17.171199    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:17.173222 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:24:17.173194    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff919f0_fc07_4639_888b_255d5de46c3a.slice/crio-949e518704d06da0f634e44769d6823ee25024357693009be55ed5ff4f2f02a1 WatchSource:0}: Error finding container 949e518704d06da0f634e44769d6823ee25024357693009be55ed5ff4f2f02a1: Status 404 returned error can't find the container with id 949e518704d06da0f634e44769d6823ee25024357693009be55ed5ff4f2f02a1
Jul 23 18:24:17.575293 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:17.575255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" event={"ID":"9ff919f0-fc07-4639-888b-255d5de46c3a","Type":"ContainerStarted","Data":"949e518704d06da0f634e44769d6823ee25024357693009be55ed5ff4f2f02a1"}
Jul 23 18:24:20.588836 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:20.588804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" event={"ID":"9ff919f0-fc07-4639-888b-255d5de46c3a","Type":"ContainerStarted","Data":"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"}
Jul 23 18:24:20.589228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:20.588869    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:31.593680 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:31.593648    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:31.613115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:31.613053    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" podStartSLOduration=12.817156571 podStartE2EDuration="15.613033247s" totalImagesPullingTime="2.795876676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:20.61372207 +0000 UTC m=+499.707367488" watchObservedRunningTime="2026-07-23 18:24:31.613033247 +0000 UTC m=+510.706678664"
Jul 23 18:24:32.051873 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.051834    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:32.052055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.052031    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" podUID="9ff919f0-fc07-4639-888b-255d5de46c3a" containerName="limitador" containerID="cri-o://8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b" gracePeriod=30
Jul 23 18:24:32.588414 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.588383    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:32.599865 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.599839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file\") pod \"9ff919f0-fc07-4639-888b-255d5de46c3a\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") "
Jul 23 18:24:32.600258 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.599984    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwlxf\" (UniqueName: \"kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf\") pod \"9ff919f0-fc07-4639-888b-255d5de46c3a\" (UID: \"9ff919f0-fc07-4639-888b-255d5de46c3a\") "
Jul 23 18:24:32.600258 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.600107    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file" (OuterVolumeSpecName: "config-file") pod "9ff919f0-fc07-4639-888b-255d5de46c3a" (UID: "9ff919f0-fc07-4639-888b-255d5de46c3a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:24:32.600347 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.600265    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff919f0-fc07-4639-888b-255d5de46c3a-config-file\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:24:32.602047 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.602025    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf" (OuterVolumeSpecName: "kube-api-access-kwlxf") pod "9ff919f0-fc07-4639-888b-255d5de46c3a" (UID: "9ff919f0-fc07-4639-888b-255d5de46c3a"). InnerVolumeSpecName "kube-api-access-kwlxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:24:32.637965 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.637878    2562 generic.go:356] "Generic (PLEG): container finished" podID="9ff919f0-fc07-4639-888b-255d5de46c3a" containerID="8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b" exitCode=0
Jul 23 18:24:32.637965 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.637922    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"
Jul 23 18:24:32.638173 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.637966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" event={"ID":"9ff919f0-fc07-4639-888b-255d5de46c3a","Type":"ContainerDied","Data":"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"}
Jul 23 18:24:32.638173 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.638023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gq2jj" event={"ID":"9ff919f0-fc07-4639-888b-255d5de46c3a","Type":"ContainerDied","Data":"949e518704d06da0f634e44769d6823ee25024357693009be55ed5ff4f2f02a1"}
Jul 23 18:24:32.638173 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.638049    2562 scope.go:117] "RemoveContainer" containerID="8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"
Jul 23 18:24:32.648448 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.648368    2562 scope.go:117] "RemoveContainer" containerID="8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"
Jul 23 18:24:32.649367 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:24:32.649330    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b\": container with ID starting with 8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b not found: ID does not exist" containerID="8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"
Jul 23 18:24:32.649551 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.649520    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b"} err="failed to get container status \"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b\": rpc error: code = NotFound desc = could not find container \"8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b\": container with ID starting with 8e65990b5d0f1f5741c236afce7065357cf8e7471c8170b8128a791e471d7f6b not found: ID does not exist"
Jul 23 18:24:32.662338 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.662314    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:32.664775 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.664752    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gq2jj"]
Jul 23 18:24:32.700840 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:32.700805    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwlxf\" (UniqueName: \"kubernetes.io/projected/9ff919f0-fc07-4639-888b-255d5de46c3a-kube-api-access-kwlxf\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:24:33.574466 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:33.574432    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff919f0-fc07-4639-888b-255d5de46c3a" path="/var/lib/kubelet/pods/9ff919f0-fc07-4639-888b-255d5de46c3a/volumes"
Jul 23 18:24:38.430195 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.430163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"]
Jul 23 18:24:38.430621 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.430551    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff919f0-fc07-4639-888b-255d5de46c3a" containerName="limitador"
Jul 23 18:24:38.430621 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.430565    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff919f0-fc07-4639-888b-255d5de46c3a" containerName="limitador"
Jul 23 18:24:38.430621 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.430622    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff919f0-fc07-4639-888b-255d5de46c3a" containerName="limitador"
Jul 23 18:24:38.434887 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.434868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.437930 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.437907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:24:38.438063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.437907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-22jr6\""
Jul 23 18:24:38.439215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.439197    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 18:24:38.439333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.439310    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 18:24:38.449910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.449889    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"]
Jul 23 18:24:38.454885 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.454865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/60384ba0-4f3e-4721-926e-30f97dd0d645-data\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.455019 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.455001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq422\" (UniqueName: \"kubernetes.io/projected/60384ba0-4f3e-4721-926e-30f97dd0d645-kube-api-access-nq422\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.556218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.556176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq422\" (UniqueName: \"kubernetes.io/projected/60384ba0-4f3e-4721-926e-30f97dd0d645-kube-api-access-nq422\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.556218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.556218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/60384ba0-4f3e-4721-926e-30f97dd0d645-data\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.556594 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.556578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/60384ba0-4f3e-4721-926e-30f97dd0d645-data\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.567232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.567206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq422\" (UniqueName: \"kubernetes.io/projected/60384ba0-4f3e-4721-926e-30f97dd0d645-kube-api-access-nq422\") pod \"postgres-69fb4594cf-gqgfd\" (UID: \"60384ba0-4f3e-4721-926e-30f97dd0d645\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.745224 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.745117    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:38.885670 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:38.885645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"]
Jul 23 18:24:38.888327 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:24:38.888300    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60384ba0_4f3e_4721_926e_30f97dd0d645.slice/crio-59bc7bc785cb14726741b3e6fe058e7eec74a66396bffc2883b3bc78b65a244f WatchSource:0}: Error finding container 59bc7bc785cb14726741b3e6fe058e7eec74a66396bffc2883b3bc78b65a244f: Status 404 returned error can't find the container with id 59bc7bc785cb14726741b3e6fe058e7eec74a66396bffc2883b3bc78b65a244f
Jul 23 18:24:39.668200 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:39.668164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd" event={"ID":"60384ba0-4f3e-4721-926e-30f97dd0d645","Type":"ContainerStarted","Data":"59bc7bc785cb14726741b3e6fe058e7eec74a66396bffc2883b3bc78b65a244f"}
Jul 23 18:24:44.697417 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:44.697381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd" event={"ID":"60384ba0-4f3e-4721-926e-30f97dd0d645","Type":"ContainerStarted","Data":"8351a9a02e37e1a56615b0302759768f52c6ddb9f5293a3de409e07235ce71a9"}
Jul 23 18:24:44.697858 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:44.697500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:44.714959 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:44.714910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd" podStartSLOduration=1.6569573549999999 podStartE2EDuration="6.714894352s" totalImagesPullingTime="5.057936997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:24:44.713606027 +0000 UTC m=+523.807251444" watchObservedRunningTime="2026-07-23 18:24:44.714894352 +0000 UTC m=+523.808539768"
Jul 23 18:24:50.731129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:50.731099    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gqgfd"
Jul 23 18:24:58.179473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.179381    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:24:58.183224 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.183200    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.186092 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.186059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:24:58.186267 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.186127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:24:58.186267 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.186150    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmpzr\""
Jul 23 18:24:58.193934 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.193911    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:24:58.334713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.334665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.334912 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.334785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.359454 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.359423    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:24:58.362951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.362931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.373664 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.373639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:24:58.435650 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.435552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.435650 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.435593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7d9\" (UniqueName: \"kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.435650 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.435623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.435887 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.435767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.435931 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:24:58.435891    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 18:24:58.435975 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:24:58.435965    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert podName:e6a4859c-68f0-49d4-a641-af6750d6a026 nodeName:}" failed. No retries permitted until 2026-07-23 18:24:58.935947946 +0000 UTC m=+538.029593346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert") pod "maas-controller-55d9fdd99b-rs9d7" (UID: "e6a4859c-68f0-49d4-a641-af6750d6a026") : secret "maas-controller-webhook-cert" not found
Jul 23 18:24:58.445564 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.445528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.536539 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.536459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7d9\" (UniqueName: \"kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.536728 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.536549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.536728 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:24:58.536699    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 18:24:58.536800 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:24:58.536759    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert podName:c446c991-f504-4fc6-b94f-a21f054b516e nodeName:}" failed. No retries permitted until 2026-07-23 18:24:59.036743381 +0000 UTC m=+538.130388776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert") pod "maas-controller-58f696bbc7-ptqpc" (UID: "c446c991-f504-4fc6-b94f-a21f054b516e") : secret "maas-controller-webhook-cert" not found
Jul 23 18:24:58.546155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.546121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7d9\" (UniqueName: \"kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:58.940727 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.940681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:58.943110 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:58.943084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") pod \"maas-controller-55d9fdd99b-rs9d7\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") " pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:59.041739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.041702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:59.044184 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.044154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") pod \"maas-controller-58f696bbc7-ptqpc\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") " pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:59.094795 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.094768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:24:59.227900 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.227874    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:24:59.230224 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:24:59.230197    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a4859c_68f0_49d4_a641_af6750d6a026.slice/crio-cc72245daa18d1aba4f76b8e6fb723fcb6e3ee79d6119af39bdc2c7494a5d666 WatchSource:0}: Error finding container cc72245daa18d1aba4f76b8e6fb723fcb6e3ee79d6119af39bdc2c7494a5d666: Status 404 returned error can't find the container with id cc72245daa18d1aba4f76b8e6fb723fcb6e3ee79d6119af39bdc2c7494a5d666
Jul 23 18:24:59.274179 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.274149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:24:59.404640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.404616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:24:59.406433 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:24:59.406405    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc446c991_f504_4fc6_b94f_a21f054b516e.slice/crio-7836f3029ac91fd47d442e151a16abbab52e4dc791ce343c166109096412999a WatchSource:0}: Error finding container 7836f3029ac91fd47d442e151a16abbab52e4dc791ce343c166109096412999a: Status 404 returned error can't find the container with id 7836f3029ac91fd47d442e151a16abbab52e4dc791ce343c166109096412999a
Jul 23 18:24:59.760845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.760806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" event={"ID":"e6a4859c-68f0-49d4-a641-af6750d6a026","Type":"ContainerStarted","Data":"cc72245daa18d1aba4f76b8e6fb723fcb6e3ee79d6119af39bdc2c7494a5d666"}
Jul 23 18:24:59.761876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:24:59.761848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" event={"ID":"c446c991-f504-4fc6-b94f-a21f054b516e","Type":"ContainerStarted","Data":"7836f3029ac91fd47d442e151a16abbab52e4dc791ce343c166109096412999a"}
Jul 23 18:25:01.791323 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:01.791295    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:25:02.777668 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.777615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" event={"ID":"e6a4859c-68f0-49d4-a641-af6750d6a026","Type":"ContainerStarted","Data":"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"}
Jul 23 18:25:02.777847 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.777722    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:25:02.779175 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.779147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" event={"ID":"c446c991-f504-4fc6-b94f-a21f054b516e","Type":"ContainerStarted","Data":"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"}
Jul 23 18:25:02.779321 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.779295    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:25:02.797950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.797883    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" podStartSLOduration=2.241023969 podStartE2EDuration="4.797863672s" totalImagesPullingTime="2.556839703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:02.7967175 +0000 UTC m=+541.890362920" watchObservedRunningTime="2026-07-23 18:25:02.797863672 +0000 UTC m=+541.891509088"
Jul 23 18:25:02.814894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:02.814847    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" podStartSLOduration=2.427978205 podStartE2EDuration="4.814830888s" totalImagesPullingTime="2.386852683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:02.813456853 +0000 UTC m=+541.907102266" watchObservedRunningTime="2026-07-23 18:25:02.814830888 +0000 UTC m=+541.908476304"
Jul 23 18:25:13.786554 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:13.786521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:25:13.787041 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:13.786609    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:25:13.856524 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:13.856473    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:25:13.856754 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:13.856715    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" podUID="e6a4859c-68f0-49d4-a641-af6750d6a026" containerName="manager" containerID="cri-o://39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88" gracePeriod=30
Jul 23 18:25:14.172974 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.172941    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:25:14.285284 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.285253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm\") pod \"e6a4859c-68f0-49d4-a641-af6750d6a026\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") "
Jul 23 18:25:14.285284 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.285288    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") pod \"e6a4859c-68f0-49d4-a641-af6750d6a026\" (UID: \"e6a4859c-68f0-49d4-a641-af6750d6a026\") "
Jul 23 18:25:14.287505 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.287462    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e6a4859c-68f0-49d4-a641-af6750d6a026" (UID: "e6a4859c-68f0-49d4-a641-af6750d6a026"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:25:14.287505 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.287494    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm" (OuterVolumeSpecName: "kube-api-access-dd9zm") pod "e6a4859c-68f0-49d4-a641-af6750d6a026" (UID: "e6a4859c-68f0-49d4-a641-af6750d6a026"). InnerVolumeSpecName "kube-api-access-dd9zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:25:14.386188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.386103    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd9zm\" (UniqueName: \"kubernetes.io/projected/e6a4859c-68f0-49d4-a641-af6750d6a026-kube-api-access-dd9zm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:25:14.386188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.386137    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6a4859c-68f0-49d4-a641-af6750d6a026-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:25:14.834523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.834466    2562 generic.go:356] "Generic (PLEG): container finished" podID="e6a4859c-68f0-49d4-a641-af6750d6a026" containerID="39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88" exitCode=0
Jul 23 18:25:14.834943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.834518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" event={"ID":"e6a4859c-68f0-49d4-a641-af6750d6a026","Type":"ContainerDied","Data":"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"}
Jul 23 18:25:14.834943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.834539    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7"
Jul 23 18:25:14.834943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.834579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55d9fdd99b-rs9d7" event={"ID":"e6a4859c-68f0-49d4-a641-af6750d6a026","Type":"ContainerDied","Data":"cc72245daa18d1aba4f76b8e6fb723fcb6e3ee79d6119af39bdc2c7494a5d666"}
Jul 23 18:25:14.834943 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.834594    2562 scope.go:117] "RemoveContainer" containerID="39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"
Jul 23 18:25:14.843739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.843717    2562 scope.go:117] "RemoveContainer" containerID="39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"
Jul 23 18:25:14.844006 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:25:14.843987    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88\": container with ID starting with 39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88 not found: ID does not exist" containerID="39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"
Jul 23 18:25:14.844072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.844015    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88"} err="failed to get container status \"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88\": rpc error: code = NotFound desc = could not find container \"39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88\": container with ID starting with 39b5c452b0183962af0cd2ab56bf6c7e0582a2c57562da6a96b2ef9be2d5cd88 not found: ID does not exist"
Jul 23 18:25:14.857011 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.856989    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:25:14.860354 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:14.860330    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55d9fdd99b-rs9d7"]
Jul 23 18:25:15.574578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:15.574550    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a4859c-68f0-49d4-a641-af6750d6a026" path="/var/lib/kubelet/pods/e6a4859c-68f0-49d4-a641-af6750d6a026/volumes"
Jul 23 18:25:34.355987 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.355945    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"]
Jul 23 18:25:34.356526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.356298    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a4859c-68f0-49d4-a641-af6750d6a026" containerName="manager"
Jul 23 18:25:34.356526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.356310    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a4859c-68f0-49d4-a641-af6750d6a026" containerName="manager"
Jul 23 18:25:34.356526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.356375    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a4859c-68f0-49d4-a641-af6750d6a026" containerName="manager"
Jul 23 18:25:34.364426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.364397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.367106 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.367024    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 18:25:34.368290 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.368264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"]
Jul 23 18:25:34.434975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.434936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.435182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.434986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdp72\" (UniqueName: \"kubernetes.io/projected/4679668f-1dc5-4d8f-a54d-90acc4d5b091-kube-api-access-xdp72\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.435182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.435084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4679668f-1dc5-4d8f-a54d-90acc4d5b091-openshift-service-ca\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.536547 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.536470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.536758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.536570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdp72\" (UniqueName: \"kubernetes.io/projected/4679668f-1dc5-4d8f-a54d-90acc4d5b091-kube-api-access-xdp72\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.536758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.536638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4679668f-1dc5-4d8f-a54d-90acc4d5b091-openshift-service-ca\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.536758 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:25:34.536638    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 23 18:25:34.536758 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:25:34.536723    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls podName:4679668f-1dc5-4d8f-a54d-90acc4d5b091 nodeName:}" failed. No retries permitted until 2026-07-23 18:25:35.03670008 +0000 UTC m=+574.130345481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls") pod "maas-api-987c8d7cd-89tq5" (UID: "4679668f-1dc5-4d8f-a54d-90acc4d5b091") : secret "maas-api-serving-cert" not found
Jul 23 18:25:34.537286 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.537256    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4679668f-1dc5-4d8f-a54d-90acc4d5b091-openshift-service-ca\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.546158 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.546138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdp72\" (UniqueName: \"kubernetes.io/projected/4679668f-1dc5-4d8f-a54d-90acc4d5b091-kube-api-access-xdp72\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:34.863764 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.863732    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"]
Jul 23 18:25:34.867790 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.867751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:34.870460 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.870435    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 18:25:34.877887 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.877859    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"]
Jul 23 18:25:34.940697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.940659    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zfks\" (UniqueName: \"kubernetes.io/projected/8879a411-eeff-482c-ace0-934eb4921977-kube-api-access-6zfks\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:34.940870 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:34.940728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8879a411-eeff-482c-ace0-934eb4921977-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.041929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.041891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:35.042162 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.041987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zfks\" (UniqueName: \"kubernetes.io/projected/8879a411-eeff-482c-ace0-934eb4921977-kube-api-access-6zfks\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.042162 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.042053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8879a411-eeff-482c-ace0-934eb4921977-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.042959 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.042926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8879a411-eeff-482c-ace0-934eb4921977-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.044933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.044907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4679668f-1dc5-4d8f-a54d-90acc4d5b091-maas-api-tls\") pod \"maas-api-987c8d7cd-89tq5\" (UID: \"4679668f-1dc5-4d8f-a54d-90acc4d5b091\") " pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:35.051777 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.051724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zfks\" (UniqueName: \"kubernetes.io/projected/8879a411-eeff-482c-ace0-934eb4921977-kube-api-access-6zfks\") pod \"payload-pre-processing-7677b774bb-7wjnq\" (UID: \"8879a411-eeff-482c-ace0-934eb4921977\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.180515 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.180409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:35.276159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.276127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:35.348363 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.348277    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"]
Jul 23 18:25:35.353167 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:25:35.353139    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8879a411_eeff_482c_ace0_934eb4921977.slice/crio-afde243ae68291ef686dfd01cd2b2a6ed71d0c64f2f4b100902ac2c18ab1cfec WatchSource:0}: Error finding container afde243ae68291ef686dfd01cd2b2a6ed71d0c64f2f4b100902ac2c18ab1cfec: Status 404 returned error can't find the container with id afde243ae68291ef686dfd01cd2b2a6ed71d0c64f2f4b100902ac2c18ab1cfec
Jul 23 18:25:35.460413 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.460389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"]
Jul 23 18:25:35.462552 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:25:35.462523    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4679668f_1dc5_4d8f_a54d_90acc4d5b091.slice/crio-42d7bf654126a30cdacf0702b088ff7dba19fe00d1632d665702790e3df68c69 WatchSource:0}: Error finding container 42d7bf654126a30cdacf0702b088ff7dba19fe00d1632d665702790e3df68c69: Status 404 returned error can't find the container with id 42d7bf654126a30cdacf0702b088ff7dba19fe00d1632d665702790e3df68c69
Jul 23 18:25:35.953506 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.951403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq" event={"ID":"8879a411-eeff-482c-ace0-934eb4921977","Type":"ContainerStarted","Data":"afde243ae68291ef686dfd01cd2b2a6ed71d0c64f2f4b100902ac2c18ab1cfec"}
Jul 23 18:25:35.955540 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:35.955446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5" event={"ID":"4679668f-1dc5-4d8f-a54d-90acc4d5b091","Type":"ContainerStarted","Data":"42d7bf654126a30cdacf0702b088ff7dba19fe00d1632d665702790e3df68c69"}
Jul 23 18:25:37.970380 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:37.970268    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq" event={"ID":"8879a411-eeff-482c-ace0-934eb4921977","Type":"ContainerStarted","Data":"cf626b7335cd11f7f21da46f2ce948bb70bfff7b7885ff596ed7c71d0e39e472"}
Jul 23 18:25:37.970380 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:37.970373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:25:37.971975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:37.971925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5" event={"ID":"4679668f-1dc5-4d8f-a54d-90acc4d5b091","Type":"ContainerStarted","Data":"af83a5a0dacdd5cd2ccdb9ea9b114639f238f28a4c5c8b9e8efad19a6ca69be4"}
Jul 23 18:25:37.971975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:37.971977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:37.988849 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:37.988804    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq" podStartSLOduration=1.535847562 podStartE2EDuration="3.988789291s" totalImagesPullingTime="2.452941729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:37.98806302 +0000 UTC m=+577.081708438" watchObservedRunningTime="2026-07-23 18:25:37.988789291 +0000 UTC m=+577.082434707"
Jul 23 18:25:38.005834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:38.005790    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5" podStartSLOduration=1.6611688610000002 podStartE2EDuration="4.005774874s" totalImagesPullingTime="2.344606013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:25:38.005167729 +0000 UTC m=+577.098813149" watchObservedRunningTime="2026-07-23 18:25:38.005774874 +0000 UTC m=+577.099420330"
Jul 23 18:25:42.996546 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.996512    2562 generic.go:356] "Generic (PLEG): container finished" podID="68bd3d8b-4b74-4ba0-ad51-66750a9dc68e" containerID="0440ef882586f6cf74f6814e8c2ab85003a703f9af4df26040b300ad76df20ef" exitCode=0
Jul 23 18:25:42.997042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.996584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" event={"ID":"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e","Type":"ContainerDied","Data":"0440ef882586f6cf74f6814e8c2ab85003a703f9af4df26040b300ad76df20ef"}
Jul 23 18:25:42.997042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.996970    2562 scope.go:117] "RemoveContainer" containerID="0440ef882586f6cf74f6814e8c2ab85003a703f9af4df26040b300ad76df20ef"
Jul 23 18:25:42.997944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.997916    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:42.998015 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.997983    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:42.998059 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:42.998015    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:25:43.981455 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:43.981419    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-987c8d7cd-89tq5"
Jul 23 18:25:44.002954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:44.002923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" event={"ID":"68bd3d8b-4b74-4ba0-ad51-66750a9dc68e","Type":"ContainerStarted","Data":"4ab8008ffbbb68754bbae991825c74b1b8a51d855b369356a577bcccdbbf29c0"}
Jul 23 18:25:44.249903 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:44.249802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:25:44.251166 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:44.251136    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hgtjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 18:25:44.251302 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:44.251199    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" podUID="68bd3d8b-4b74-4ba0-ad51-66750a9dc68e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 18:25:45.249929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:45.249890    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hgtjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 18:25:45.250540 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:45.249958    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" podUID="68bd3d8b-4b74-4ba0-ad51-66750a9dc68e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 18:25:46.250296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:46.250260    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hgtjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 18:25:46.250766 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:46.250322    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" podUID="68bd3d8b-4b74-4ba0-ad51-66750a9dc68e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 18:25:46.569434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:46.569393    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:25:47.249650 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:47.249616    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-hgtjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 23 18:25:47.249863 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:47.249672    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt" podUID="68bd3d8b-4b74-4ba0-ad51-66750a9dc68e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 23 18:25:48.254029 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:48.253994    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:25:48.255157 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:48.255138    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-hgtjt"
Jul 23 18:25:48.978697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:25:48.978665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-7wjnq"
Jul 23 18:26:05.102933 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.102894    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"]
Jul 23 18:26:05.108015 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.107992    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.110733 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.110701    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:26:05.110880 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.110768    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7pzzs\""
Jul 23 18:26:05.112016 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.112000    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 18:26:05.112099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.112032    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:26:05.117621 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.117596    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"]
Jul 23 18:26:05.225265 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.225452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.225452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.225452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.225452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.225623 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.225501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcnqb\" (UniqueName: \"kubernetes.io/projected/df7060b6-c106-47cd-ba01-76c2cf55d9a7-kube-api-access-hcnqb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.326861 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.326821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.326861 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.326868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.326897    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.326928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcnqb\" (UniqueName: \"kubernetes.io/projected/df7060b6-c106-47cd-ba01-76c2cf55d9a7-kube-api-access-hcnqb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.326971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.327019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327322 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.327305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327396 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.327366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.327497 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.327460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.329418 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.329393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7060b6-c106-47cd-ba01-76c2cf55d9a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.329620 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.329603    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7060b6-c106-47cd-ba01-76c2cf55d9a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.335739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.335712    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcnqb\" (UniqueName: \"kubernetes.io/projected/df7060b6-c106-47cd-ba01-76c2cf55d9a7-kube-api-access-hcnqb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2\" (UID: \"df7060b6-c106-47cd-ba01-76c2cf55d9a7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.421704 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.421604    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:05.556534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:05.556498    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"]
Jul 23 18:26:05.559048 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:26:05.559023    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf7060b6_c106_47cd_ba01_76c2cf55d9a7.slice/crio-de5e0429bcc126f64ba439c39fb340fcb4c59513d5bc6c2ea75b1574a5adf646 WatchSource:0}: Error finding container de5e0429bcc126f64ba439c39fb340fcb4c59513d5bc6c2ea75b1574a5adf646: Status 404 returned error can't find the container with id de5e0429bcc126f64ba439c39fb340fcb4c59513d5bc6c2ea75b1574a5adf646
Jul 23 18:26:06.101163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:06.101121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2" event={"ID":"df7060b6-c106-47cd-ba01-76c2cf55d9a7","Type":"ContainerStarted","Data":"de5e0429bcc126f64ba439c39fb340fcb4c59513d5bc6c2ea75b1574a5adf646"}
Jul 23 18:26:07.107714 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:07.107619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2" event={"ID":"df7060b6-c106-47cd-ba01-76c2cf55d9a7","Type":"ContainerStarted","Data":"6ab8acfef97d70a7c415d582ac117e41e4d64aa8500fdb2ac9c4ffa8ce90be4b"}
Jul 23 18:26:07.128602 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:07.128546    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2" podStartSLOduration=0.887044324 podStartE2EDuration="2.128526674s" totalImagesPullingTime="1.24148235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:07.126672423 +0000 UTC m=+606.220317853" watchObservedRunningTime="2026-07-23 18:26:07.128526674 +0000 UTC m=+606.222172094"
Jul 23 18:26:15.421763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:15.421712    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:15.422272 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:15.421815    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:15.434848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:15.434819    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:16.160026 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:16.159999    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2"
Jul 23 18:26:57.594688 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.594654    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"]
Jul 23 18:26:57.597971 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.597954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.600911 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.600887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 18:26:57.608600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.608575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"]
Jul 23 18:26:57.689398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rp8\" (UniqueName: \"kubernetes.io/projected/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-kube-api-access-55rp8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.689591 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.689591 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.689591 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.689591 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.689591 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.689538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790251 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rp8\" (UniqueName: \"kubernetes.io/projected/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-kube-api-access-55rp8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790426 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790856 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790941 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.790941 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.790874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.792622 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.792602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.792858 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.792837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.798516 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.798495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rp8\" (UniqueName: \"kubernetes.io/projected/f9fec76a-f83a-453e-97b0-b5f53f4ef12a-kube-api-access-55rp8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5\" (UID: \"f9fec76a-f83a-453e-97b0-b5f53f4ef12a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:57.909727 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:57.909639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:26:58.059575 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:58.059549    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"]
Jul 23 18:26:58.061612 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:26:58.061579    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9fec76a_f83a_453e_97b0_b5f53f4ef12a.slice/crio-d0aee0b63cbdfa59781261dec69b1bfe6a238fec9de695ce9c07db1552c90dc1 WatchSource:0}: Error finding container d0aee0b63cbdfa59781261dec69b1bfe6a238fec9de695ce9c07db1552c90dc1: Status 404 returned error can't find the container with id d0aee0b63cbdfa59781261dec69b1bfe6a238fec9de695ce9c07db1552c90dc1
Jul 23 18:26:58.063033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:58.063013    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:26:58.333093 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:58.333059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5" event={"ID":"f9fec76a-f83a-453e-97b0-b5f53f4ef12a","Type":"ContainerStarted","Data":"dc7e081435a49fae8592d50e94b0100b16b29420a878e8d6db05018c452c530c"}
Jul 23 18:26:58.333265 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:58.333140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5" event={"ID":"f9fec76a-f83a-453e-97b0-b5f53f4ef12a","Type":"ContainerStarted","Data":"d0aee0b63cbdfa59781261dec69b1bfe6a238fec9de695ce9c07db1552c90dc1"}
Jul 23 18:26:58.355645 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:26:58.355593    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5" podStartSLOduration=1.161607783 podStartE2EDuration="1.355574714s" totalImagesPullingTime="193.966931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:26:58.352732987 +0000 UTC m=+657.446378404" watchObservedRunningTime="2026-07-23 18:26:58.355574714 +0000 UTC m=+657.449220132"
Jul 23 18:27:07.910186 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:27:07.910142    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:27:07.910689 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:27:07.910210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:27:07.923045 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:27:07.923022    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:27:08.388569 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:27:08.388535    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5"
Jul 23 18:29:05.123954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.123912    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:29:05.124548 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.124198    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" podUID="c446c991-f504-4fc6-b94f-a21f054b516e" containerName="manager" containerID="cri-o://def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710" gracePeriod=30
Jul 23 18:29:05.376121 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.376056    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:29:05.465238 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.465207    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw7d9\" (UniqueName: \"kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9\") pod \"c446c991-f504-4fc6-b94f-a21f054b516e\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") "
Jul 23 18:29:05.465434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.465349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") pod \"c446c991-f504-4fc6-b94f-a21f054b516e\" (UID: \"c446c991-f504-4fc6-b94f-a21f054b516e\") "
Jul 23 18:29:05.467337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.467295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9" (OuterVolumeSpecName: "kube-api-access-gw7d9") pod "c446c991-f504-4fc6-b94f-a21f054b516e" (UID: "c446c991-f504-4fc6-b94f-a21f054b516e"). InnerVolumeSpecName "kube-api-access-gw7d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:29:05.467337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.467310    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c446c991-f504-4fc6-b94f-a21f054b516e" (UID: "c446c991-f504-4fc6-b94f-a21f054b516e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:29:05.566984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.566944    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw7d9\" (UniqueName: \"kubernetes.io/projected/c446c991-f504-4fc6-b94f-a21f054b516e-kube-api-access-gw7d9\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:29:05.566984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.566978    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c446c991-f504-4fc6-b94f-a21f054b516e-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:29:05.912398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.912359    2562 generic.go:356] "Generic (PLEG): container finished" podID="c446c991-f504-4fc6-b94f-a21f054b516e" containerID="def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710" exitCode=0
Jul 23 18:29:05.912588 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.912410    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-ptqpc"
Jul 23 18:29:05.912588 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.912446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" event={"ID":"c446c991-f504-4fc6-b94f-a21f054b516e","Type":"ContainerDied","Data":"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"}
Jul 23 18:29:05.912588 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.912516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-ptqpc" event={"ID":"c446c991-f504-4fc6-b94f-a21f054b516e","Type":"ContainerDied","Data":"7836f3029ac91fd47d442e151a16abbab52e4dc791ce343c166109096412999a"}
Jul 23 18:29:05.912588 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.912540    2562 scope.go:117] "RemoveContainer" containerID="def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"
Jul 23 18:29:05.921277 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.921262    2562 scope.go:117] "RemoveContainer" containerID="def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"
Jul 23 18:29:05.921534 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:29:05.921512    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710\": container with ID starting with def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710 not found: ID does not exist" containerID="def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"
Jul 23 18:29:05.921613 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.921540    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710"} err="failed to get container status \"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710\": rpc error: code = NotFound desc = could not find container \"def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710\": container with ID starting with def11837c8bf144b7dab7e8f6e1627681fadb1766c9902649b4a533f908e0710 not found: ID does not exist"
Jul 23 18:29:05.932990 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.932961    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:29:05.934539 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:05.934516    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-ptqpc"]
Jul 23 18:29:07.573835 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:29:07.573793    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c446c991-f504-4fc6-b94f-a21f054b516e" path="/var/lib/kubelet/pods/c446c991-f504-4fc6-b94f-a21f054b516e/volumes"
Jul 23 18:30:00.150116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.150078    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"]
Jul 23 18:30:00.150576 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.150425    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c446c991-f504-4fc6-b94f-a21f054b516e" containerName="manager"
Jul 23 18:30:00.150576 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.150436    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c446c991-f504-4fc6-b94f-a21f054b516e" containerName="manager"
Jul 23 18:30:00.150576 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.150516    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c446c991-f504-4fc6-b94f-a21f054b516e" containerName="manager"
Jul 23 18:30:00.153464 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.153448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"
Jul 23 18:30:00.156295 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.156272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-nr4sd\""
Jul 23 18:30:00.165737 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.165708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"]
Jul 23 18:30:00.167269 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.167239    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"
Jul 23 18:30:00.330230 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:00.330184    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"]
Jul 23 18:30:00.332648 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:30:00.332618    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce8307be_7856_4639_ae81_dd50a95af233.slice/crio-e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139 WatchSource:0}: Error finding container e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139: Status 404 returned error can't find the container with id e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139
Jul 23 18:30:01.168945 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:01.168900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk" event={"ID":"ce8307be-7856-4639-ae81-dd50a95af233","Type":"ContainerStarted","Data":"e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139"}
Jul 23 18:30:03.179753 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:03.179656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk" event={"ID":"ce8307be-7856-4639-ae81-dd50a95af233","Type":"ContainerStarted","Data":"522570b131c069a89d3970bd75b4610db91c1eeab510f3aea8e680a216dd3932"}
Jul 23 18:30:03.198302 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:03.198230    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk" podStartSLOduration=0.99841704 podStartE2EDuration="3.198214475s" totalImagesPullingTime="2.199797435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:03.197341757 +0000 UTC m=+842.290987174" watchObservedRunningTime="2026-07-23 18:30:03.198214475 +0000 UTC m=+842.291859892"
Jul 23 18:30:04.187489 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:04.187441    2562 generic.go:356] "Generic (PLEG): container finished" podID="ce8307be-7856-4639-ae81-dd50a95af233" containerID="522570b131c069a89d3970bd75b4610db91c1eeab510f3aea8e680a216dd3932" exitCode=0
Jul 23 18:30:04.187877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:04.187538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk" event={"ID":"ce8307be-7856-4639-ae81-dd50a95af233","Type":"ContainerDied","Data":"522570b131c069a89d3970bd75b4610db91c1eeab510f3aea8e680a216dd3932"}
Jul 23 18:30:05.324738 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:05.324711    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"
Jul 23 18:30:06.197317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.197287    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk"
Jul 23 18:30:06.197536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.197324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-nl9xk" event={"ID":"ce8307be-7856-4639-ae81-dd50a95af233","Type":"ContainerDied","Data":"e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139"}
Jul 23 18:30:06.197536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.197371    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e34f5df802ff25918fbe344ad0b514da3d55abcf5bccff17cc795a3fb809d139"
Jul 23 18:30:06.753573 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.753541    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:06.753962 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.753930    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce8307be-7856-4639-ae81-dd50a95af233" containerName="cleanup"
Jul 23 18:30:06.753962 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.753942    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce8307be-7856-4639-ae81-dd50a95af233" containerName="cleanup"
Jul 23 18:30:06.754035 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.753999    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce8307be-7856-4639-ae81-dd50a95af233" containerName="cleanup"
Jul 23 18:30:06.757138 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.757119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.761336 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.761313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:30:06.761457 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.761335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:30:06.761457 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.761375    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmpzr\""
Jul 23 18:30:06.770810 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.770786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:06.813436 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.813395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.813626 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.813448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff97z\" (UniqueName: \"kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.914238 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.914207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.914431 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.914247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff97z\" (UniqueName: \"kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.916693 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.916669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:06.924013 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:06.923984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff97z\" (UniqueName: \"kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z\") pod \"maas-controller-58f696bbc7-hc866\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") " pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:07.067371 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:07.067339    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:07.203190 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:07.203126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:07.205298 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:30:07.205268    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85df4d09_7ac6_480c_b3e0_bc8d1b01c094.slice/crio-15b24863cbf7a4ba5bb6fd698d18b38e641ad92f3030591c0fc60efeead2fb3c WatchSource:0}: Error finding container 15b24863cbf7a4ba5bb6fd698d18b38e641ad92f3030591c0fc60efeead2fb3c: Status 404 returned error can't find the container with id 15b24863cbf7a4ba5bb6fd698d18b38e641ad92f3030591c0fc60efeead2fb3c
Jul 23 18:30:08.208725 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:08.208695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-hc866" event={"ID":"85df4d09-7ac6-480c-b3e0-bc8d1b01c094","Type":"ContainerStarted","Data":"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"}
Jul 23 18:30:08.209115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:08.208742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-hc866" event={"ID":"85df4d09-7ac6-480c-b3e0-bc8d1b01c094","Type":"ContainerStarted","Data":"15b24863cbf7a4ba5bb6fd698d18b38e641ad92f3030591c0fc60efeead2fb3c"}
Jul 23 18:30:08.209115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:08.208790    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:08.231694 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:08.231654    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58f696bbc7-hc866" podStartSLOduration=1.403555148 podStartE2EDuration="2.231639177s" totalImagesPullingTime="828.084029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:08.231497274 +0000 UTC m=+847.325142700" watchObservedRunningTime="2026-07-23 18:30:08.231639177 +0000 UTC m=+847.325284618"
Jul 23 18:30:19.216389 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:19.216351    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:23.877281 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:23.877245    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:23.877798 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:23.877490    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58f696bbc7-hc866" podUID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" containerName="manager" containerID="cri-o://6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a" gracePeriod=30
Jul 23 18:30:24.146454 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.146365    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:24.283637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.283599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff97z\" (UniqueName: \"kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z\") pod \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") "
Jul 23 18:30:24.283873 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.283781    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert\") pod \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\" (UID: \"85df4d09-7ac6-480c-b3e0-bc8d1b01c094\") "
Jul 23 18:30:24.284248 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.284211    2562 generic.go:356] "Generic (PLEG): container finished" podID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" containerID="6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a" exitCode=0
Jul 23 18:30:24.284361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.284249    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-hc866" event={"ID":"85df4d09-7ac6-480c-b3e0-bc8d1b01c094","Type":"ContainerDied","Data":"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"}
Jul 23 18:30:24.284361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.284285    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-hc866"
Jul 23 18:30:24.284361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.284324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-hc866" event={"ID":"85df4d09-7ac6-480c-b3e0-bc8d1b01c094","Type":"ContainerDied","Data":"15b24863cbf7a4ba5bb6fd698d18b38e641ad92f3030591c0fc60efeead2fb3c"}
Jul 23 18:30:24.284361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.284354    2562 scope.go:117] "RemoveContainer" containerID="6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"
Jul 23 18:30:24.286055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.286031    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z" (OuterVolumeSpecName: "kube-api-access-ff97z") pod "85df4d09-7ac6-480c-b3e0-bc8d1b01c094" (UID: "85df4d09-7ac6-480c-b3e0-bc8d1b01c094"). InnerVolumeSpecName "kube-api-access-ff97z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:30:24.286140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.286068    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "85df4d09-7ac6-480c-b3e0-bc8d1b01c094" (UID: "85df4d09-7ac6-480c-b3e0-bc8d1b01c094"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:30:24.303499 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.303467    2562 scope.go:117] "RemoveContainer" containerID="6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"
Jul 23 18:30:24.303776 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:30:24.303753    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a\": container with ID starting with 6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a not found: ID does not exist" containerID="6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"
Jul 23 18:30:24.303842 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.303788    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a"} err="failed to get container status \"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a\": rpc error: code = NotFound desc = could not find container \"6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a\": container with ID starting with 6377e98e6aff494df447353b46adb7e5e80a1392f82b02efb4569785dfee4e0a not found: ID does not exist"
Jul 23 18:30:24.385088 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.385048    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff97z\" (UniqueName: \"kubernetes.io/projected/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-kube-api-access-ff97z\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:30:24.385088 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.385082    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/85df4d09-7ac6-480c-b3e0-bc8d1b01c094-webhook-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:30:24.607856 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.607820    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:24.611048 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:24.611022    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-hc866"]
Jul 23 18:30:25.406433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.406398    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58f696bbc7-7zzrt"]
Jul 23 18:30:25.406864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.406789    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" containerName="manager"
Jul 23 18:30:25.406864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.406802    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" containerName="manager"
Jul 23 18:30:25.406864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.406857    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" containerName="manager"
Jul 23 18:30:25.411291 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.411272    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.416158 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.416116    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmpzr\""
Jul 23 18:30:25.416283 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.416237    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:30:25.417368 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.417346    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:30:25.421385 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.421364    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-7zzrt"]
Jul 23 18:30:25.495454 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.495410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280803f9-2be6-4833-8d2e-85a50be14b76-webhook-cert\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.495454 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.495457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c795z\" (UniqueName: \"kubernetes.io/projected/280803f9-2be6-4833-8d2e-85a50be14b76-kube-api-access-c795z\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.575500 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.575456    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85df4d09-7ac6-480c-b3e0-bc8d1b01c094" path="/var/lib/kubelet/pods/85df4d09-7ac6-480c-b3e0-bc8d1b01c094/volumes"
Jul 23 18:30:25.596832 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.596797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280803f9-2be6-4833-8d2e-85a50be14b76-webhook-cert\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.596978 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.596839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c795z\" (UniqueName: \"kubernetes.io/projected/280803f9-2be6-4833-8d2e-85a50be14b76-kube-api-access-c795z\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.599552 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.599526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/280803f9-2be6-4833-8d2e-85a50be14b76-webhook-cert\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.606197 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.606175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c795z\" (UniqueName: \"kubernetes.io/projected/280803f9-2be6-4833-8d2e-85a50be14b76-kube-api-access-c795z\") pod \"maas-controller-58f696bbc7-7zzrt\" (UID: \"280803f9-2be6-4833-8d2e-85a50be14b76\") " pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.722918 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.722827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:25.859046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:25.859020    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58f696bbc7-7zzrt"]
Jul 23 18:30:25.860959 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:30:25.860932    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280803f9_2be6_4833_8d2e_85a50be14b76.slice/crio-a652d91b8d4da999465d5599b6169fad68373e95e72e7fc1fbd45711e340924e WatchSource:0}: Error finding container a652d91b8d4da999465d5599b6169fad68373e95e72e7fc1fbd45711e340924e: Status 404 returned error can't find the container with id a652d91b8d4da999465d5599b6169fad68373e95e72e7fc1fbd45711e340924e
Jul 23 18:30:26.296314 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:26.296280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-7zzrt" event={"ID":"280803f9-2be6-4833-8d2e-85a50be14b76","Type":"ContainerStarted","Data":"a652d91b8d4da999465d5599b6169fad68373e95e72e7fc1fbd45711e340924e"}
Jul 23 18:30:27.302037 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:27.302001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58f696bbc7-7zzrt" event={"ID":"280803f9-2be6-4833-8d2e-85a50be14b76","Type":"ContainerStarted","Data":"e79a2fc058483abadd69ecbb0be0a5eb165200e32ee4f65ee232d8e734242742"}
Jul 23 18:30:27.302445 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:27.302146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:30:27.321099 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:27.321047    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58f696bbc7-7zzrt" podStartSLOduration=1.625489488 podStartE2EDuration="2.321029732s" totalImagesPullingTime="695.540244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:27.319444726 +0000 UTC m=+866.413090146" watchObservedRunningTime="2026-07-23 18:30:27.321029732 +0000 UTC m=+866.414675206"
Jul 23 18:30:38.308973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:30:38.308938    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58f696bbc7-7zzrt"
Jul 23 18:35:10.827984 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:10.827947    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:35:10.828552 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:10.828165    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" podUID="67a59b68-0721-4ae2-9897-5f921ba3a73f" containerName="manager" containerID="cri-o://538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c" gracePeriod=10
Jul 23 18:35:13.983221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:13.983197    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:35:14.012262 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.012234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume\") pod \"67a59b68-0721-4ae2-9897-5f921ba3a73f\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") "
Jul 23 18:35:14.012392 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.012310    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4vg7\" (UniqueName: \"kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7\") pod \"67a59b68-0721-4ae2-9897-5f921ba3a73f\" (UID: \"67a59b68-0721-4ae2-9897-5f921ba3a73f\") "
Jul 23 18:35:14.012599 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.012577    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67a59b68-0721-4ae2-9897-5f921ba3a73f" (UID: "67a59b68-0721-4ae2-9897-5f921ba3a73f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:35:14.014739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.014707    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7" (OuterVolumeSpecName: "kube-api-access-v4vg7") pod "67a59b68-0721-4ae2-9897-5f921ba3a73f" (UID: "67a59b68-0721-4ae2-9897-5f921ba3a73f"). InnerVolumeSpecName "kube-api-access-v4vg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:35:14.113697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.113615    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4vg7\" (UniqueName: \"kubernetes.io/projected/67a59b68-0721-4ae2-9897-5f921ba3a73f-kube-api-access-v4vg7\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:35:14.113697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.113643    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67a59b68-0721-4ae2-9897-5f921ba3a73f-extensions-socket-volume\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:35:14.683416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.683378    2562 generic.go:356] "Generic (PLEG): container finished" podID="67a59b68-0721-4ae2-9897-5f921ba3a73f" containerID="538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c" exitCode=0
Jul 23 18:35:14.683627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.683436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" event={"ID":"67a59b68-0721-4ae2-9897-5f921ba3a73f","Type":"ContainerDied","Data":"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"}
Jul 23 18:35:14.683627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.683440    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"
Jul 23 18:35:14.683627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.683499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j" event={"ID":"67a59b68-0721-4ae2-9897-5f921ba3a73f","Type":"ContainerDied","Data":"f937f029a8c86224b8df3cbca04e15eb6777b5dd4ce7832485302222d2d3345d"}
Jul 23 18:35:14.683627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.683523    2562 scope.go:117] "RemoveContainer" containerID="538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"
Jul 23 18:35:14.696111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.696088    2562 scope.go:117] "RemoveContainer" containerID="538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"
Jul 23 18:35:14.696359 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:35:14.696340    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c\": container with ID starting with 538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c not found: ID does not exist" containerID="538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"
Jul 23 18:35:14.696424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.696368    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c"} err="failed to get container status \"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c\": rpc error: code = NotFound desc = could not find container \"538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c\": container with ID starting with 538795b025f8787950f019cd43370ce00f1ea17371218d3cdf04145bfab0222c not found: ID does not exist"
Jul 23 18:35:14.711545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.711520    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:35:14.713571 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:14.713551    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8p45j"]
Jul 23 18:35:15.575235 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:35:15.575203    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67a59b68-0721-4ae2-9897-5f921ba3a73f" path="/var/lib/kubelet/pods/67a59b68-0721-4ae2-9897-5f921ba3a73f/volumes"
Jul 23 18:36:11.956211 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.956174    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"]
Jul 23 18:36:11.956657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.956549    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67a59b68-0721-4ae2-9897-5f921ba3a73f" containerName="manager"
Jul 23 18:36:11.956657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.956562    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="67a59b68-0721-4ae2-9897-5f921ba3a73f" containerName="manager"
Jul 23 18:36:11.956657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.956646    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="67a59b68-0721-4ae2-9897-5f921ba3a73f" containerName="manager"
Jul 23 18:36:11.959872 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.959852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:11.963606 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.963586    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-4xfhr\""
Jul 23 18:36:11.979536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:11.979503    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"]
Jul 23 18:36:12.045431 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.045394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.045627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.045526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn25p\" (UniqueName: \"kubernetes.io/projected/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-kube-api-access-nn25p\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.146135 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.146094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.146290 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.146185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn25p\" (UniqueName: \"kubernetes.io/projected/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-kube-api-access-nn25p\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.146554 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.146532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.155157 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.155126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn25p\" (UniqueName: \"kubernetes.io/projected/0424f650-04f6-4588-a9d1-b6e8f7b07bfc-kube-api-access-nn25p\") pod \"kuadrant-operator-controller-manager-86878c769f-sv4h2\" (UID: \"0424f650-04f6-4588-a9d1-b6e8f7b07bfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.269696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.269658    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.415513 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.415438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"]
Jul 23 18:36:12.419433 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:36:12.419401    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0424f650_04f6_4588_a9d1_b6e8f7b07bfc.slice/crio-8015d2fdeecb7fb7da392028530e3d857c9f4d287ad0952e871e9603dcf7f1b5 WatchSource:0}: Error finding container 8015d2fdeecb7fb7da392028530e3d857c9f4d287ad0952e871e9603dcf7f1b5: Status 404 returned error can't find the container with id 8015d2fdeecb7fb7da392028530e3d857c9f4d287ad0952e871e9603dcf7f1b5
Jul 23 18:36:12.946799 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.946760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2" event={"ID":"0424f650-04f6-4588-a9d1-b6e8f7b07bfc","Type":"ContainerStarted","Data":"31a59a42719011440e7d2e1e86a4cfb47a77ad752b6e1f4def4448d6bf9aef94"}
Jul 23 18:36:12.946799 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.946810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2" event={"ID":"0424f650-04f6-4588-a9d1-b6e8f7b07bfc","Type":"ContainerStarted","Data":"8015d2fdeecb7fb7da392028530e3d857c9f4d287ad0952e871e9603dcf7f1b5"}
Jul 23 18:36:12.947038 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.946848    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:36:12.977240 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:12.977187    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2" podStartSLOduration=1.977171782 podStartE2EDuration="1.977171782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:12.977124728 +0000 UTC m=+1212.070770146" watchObservedRunningTime="2026-07-23 18:36:12.977171782 +0000 UTC m=+1212.070817199"
Jul 23 18:36:23.953905 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:36:23.953873    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sv4h2"
Jul 23 18:39:28.698775 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.698736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:39:28.702354 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.702329    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.706600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.706573    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-8c025628-kserve-self-signed-certs\""
Jul 23 18:39:28.714059 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.714036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:39:28.837294 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7s2w\" (UniqueName: \"kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.837526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.837526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837424    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.837526 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.837723 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.837723 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.837634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.938873 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.938815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.938910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.938968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7s2w\" (UniqueName: \"kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939084 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939445 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939551 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.939551 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.939504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.941321 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.941299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.941468 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.941450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:28.949405 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:28.949351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7s2w\" (UniqueName: \"kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w\") pod \"e2e-same-id-b-8c025628-kserve-75f799d867-22v5h\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") " pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:29.012702 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:29.012671    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:29.151274 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:29.151236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:39:29.152887 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:39:29.152861    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod054ba00f_221b_411d_a28f_912fa13f5422.slice/crio-079b1127e2d5f70e2c3fd1d38888594951e95c6bf3a3da2b7434296004de450e WatchSource:0}: Error finding container 079b1127e2d5f70e2c3fd1d38888594951e95c6bf3a3da2b7434296004de450e: Status 404 returned error can't find the container with id 079b1127e2d5f70e2c3fd1d38888594951e95c6bf3a3da2b7434296004de450e
Jul 23 18:39:29.875595 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:29.875560    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" event={"ID":"054ba00f-221b-411d-a28f-912fa13f5422","Type":"ContainerStarted","Data":"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"}
Jul 23 18:39:29.875595 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:29.875601    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" event={"ID":"054ba00f-221b-411d-a28f-912fa13f5422","Type":"ContainerStarted","Data":"079b1127e2d5f70e2c3fd1d38888594951e95c6bf3a3da2b7434296004de450e"}
Jul 23 18:39:29.894651 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:29.894604    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" podStartSLOduration=1.894587603 podStartE2EDuration="1.894587603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:29.893849578 +0000 UTC m=+1408.987495004" watchObservedRunningTime="2026-07-23 18:39:29.894587603 +0000 UTC m=+1408.988233020"
Jul 23 18:39:39.013223 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:39.013184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:39.013672 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:39.013527    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:39.026424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:39.026397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:39.931704 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:39.931672    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:39:48.953540 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:39:48.953502    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:40:03.974942 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:03.974852    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" podUID="054ba00f-221b-411d-a28f-912fa13f5422" containerName="main" containerID="cri-o://3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759" gracePeriod=45
Jul 23 18:40:04.223163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.223134    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:40:04.376820 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.376785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.376837    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.376900    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.376956    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377178 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377042    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7s2w\" (UniqueName: \"kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377178 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm\") pod \"054ba00f-221b-411d-a28f-912fa13f5422\" (UID: \"054ba00f-221b-411d-a28f-912fa13f5422\") "
Jul 23 18:40:04.377178 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home" (OuterVolumeSpecName: "home") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:04.377332 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377245    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache" (OuterVolumeSpecName: "model-cache") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:04.377332 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377297    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:04.377449 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377386    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-model-cache\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:04.377449 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377419    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-tmp-dir\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:04.377449 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.377432    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-home\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:04.379156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.379135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm" (OuterVolumeSpecName: "dshm") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:40:04.379237 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.379178    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:40:04.379297 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.379262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w" (OuterVolumeSpecName: "kube-api-access-s7s2w") pod "054ba00f-221b-411d-a28f-912fa13f5422" (UID: "054ba00f-221b-411d-a28f-912fa13f5422"). InnerVolumeSpecName "kube-api-access-s7s2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:40:04.478456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.478423    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054ba00f-221b-411d-a28f-912fa13f5422-tls-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:04.478456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.478450    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7s2w\" (UniqueName: \"kubernetes.io/projected/054ba00f-221b-411d-a28f-912fa13f5422-kube-api-access-s7s2w\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:04.478665 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:04.478466    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054ba00f-221b-411d-a28f-912fa13f5422-dshm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:40:05.047502 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.047445    2562 generic.go:356] "Generic (PLEG): container finished" podID="054ba00f-221b-411d-a28f-912fa13f5422" containerID="3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759" exitCode=0
Jul 23 18:40:05.047948 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.047511    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"
Jul 23 18:40:05.047948 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.047517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" event={"ID":"054ba00f-221b-411d-a28f-912fa13f5422","Type":"ContainerDied","Data":"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"}
Jul 23 18:40:05.047948 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.047553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h" event={"ID":"054ba00f-221b-411d-a28f-912fa13f5422","Type":"ContainerDied","Data":"079b1127e2d5f70e2c3fd1d38888594951e95c6bf3a3da2b7434296004de450e"}
Jul 23 18:40:05.047948 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.047571    2562 scope.go:117] "RemoveContainer" containerID="3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"
Jul 23 18:40:05.056944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.056928    2562 scope.go:117] "RemoveContainer" containerID="3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"
Jul 23 18:40:05.057244 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:40:05.057223    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759\": container with ID starting with 3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759 not found: ID does not exist" containerID="3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"
Jul 23 18:40:05.057322 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.057250    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759"} err="failed to get container status \"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759\": rpc error: code = NotFound desc = could not find container \"3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759\": container with ID starting with 3c096c128ca6f00ec7e1dd8d1ab88ed47cc5666359b008cfd159324433e2f759 not found: ID does not exist"
Jul 23 18:40:05.071532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.071507    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:40:05.075433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.075413    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-8c025628-kserve-75f799d867-22v5h"]
Jul 23 18:40:05.575463 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:40:05.575426    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054ba00f-221b-411d-a28f-912fa13f5422" path="/var/lib/kubelet/pods/054ba00f-221b-411d-a28f-912fa13f5422/volumes"
Jul 23 18:43:24.192065 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.191989    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:43:24.192563 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.192417    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054ba00f-221b-411d-a28f-912fa13f5422" containerName="main"
Jul 23 18:43:24.192563 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.192431    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="054ba00f-221b-411d-a28f-912fa13f5422" containerName="main"
Jul 23 18:43:24.192563 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.192503    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="054ba00f-221b-411d-a28f-912fa13f5422" containerName="main"
Jul 23 18:43:24.195754 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.195736    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.199799 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.199778    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9f5b583d-openshift-default-dockercfg-2fx9k\""
Jul 23 18:43:24.221566 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.221542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:43:24.289600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.289600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.289863 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.289863 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.289863 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.290024 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.290024 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmpzq\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.290024 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.289930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.290195 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.290013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391691 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmpzq\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.391897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392201 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392201 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.391954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392201 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.392142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392360 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.392339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392467 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.392451    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392599 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.392578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.392773 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.392755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.394142 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.394123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.394389 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.394372    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.401129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.401103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmpzq\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.401272 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.401253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token\") pod \"e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") " pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.506446 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.506360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:24.652433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.652399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:43:24.655711 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:43:24.655677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f08580_39ca_4a16_bc85_0aa2c0c3ad36.slice/crio-89f6ae13430d0fefa3c5b57389339d5256ee358be28f1fd8ff8095bdaae3cafe WatchSource:0}: Error finding container 89f6ae13430d0fefa3c5b57389339d5256ee358be28f1fd8ff8095bdaae3cafe: Status 404 returned error can't find the container with id 89f6ae13430d0fefa3c5b57389339d5256ee358be28f1fd8ff8095bdaae3cafe
Jul 23 18:43:24.657926 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.657890    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:24.658010 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.657963    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:24.658046 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:24.658030    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:25.000053 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:25.000016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerStarted","Data":"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"}
Jul 23 18:43:25.000230 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:25.000073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerStarted","Data":"89f6ae13430d0fefa3c5b57389339d5256ee358be28f1fd8ff8095bdaae3cafe"}
Jul 23 18:43:25.028738 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:25.028689    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podStartSLOduration=1.028672298 podStartE2EDuration="1.028672298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:25.026147398 +0000 UTC m=+1644.119792828" watchObservedRunningTime="2026-07-23 18:43:25.028672298 +0000 UTC m=+1644.122317715"
Jul 23 18:43:25.506780 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:25.506750    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:25.511793 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:25.511768    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:26.005787 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.005758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:26.006637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.006616    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:26.604845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.604802    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:43:26.608393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.608372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.611890 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.611866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jvms6\""
Jul 23 18:43:26.612019 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.611866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9f5b583d-serving-cert\""
Jul 23 18:43:26.620232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.620206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:43:26.714598 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.714558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.714776 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.714642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gckh\" (UniqueName: \"kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.714776 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.714672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.816003 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.815963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.816184 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.816054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.816184 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.816107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gckh\" (UniqueName: \"kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.816687 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.816666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.818525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.818504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.825199 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.825175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gckh\" (UniqueName: \"kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh\") pod \"maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:26.920151 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:26.920059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:27.064610 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:27.064561    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:43:27.065150 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:43:27.065111    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca1ca9e0_6309_4bea_987d_bcb67b55a71d.slice/crio-4f3121850eb033e4d174baf656fdffae02bcae5ab7560eb35e09ae5f35a93723 WatchSource:0}: Error finding container 4f3121850eb033e4d174baf656fdffae02bcae5ab7560eb35e09ae5f35a93723: Status 404 returned error can't find the container with id 4f3121850eb033e4d174baf656fdffae02bcae5ab7560eb35e09ae5f35a93723
Jul 23 18:43:27.066818 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:27.066798    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:43:28.020219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:28.020183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" event={"ID":"ca1ca9e0-6309-4bea-987d-bcb67b55a71d","Type":"ContainerStarted","Data":"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"}
Jul 23 18:43:28.020627 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:28.020236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" event={"ID":"ca1ca9e0-6309-4bea-987d-bcb67b55a71d","Type":"ContainerStarted","Data":"4f3121850eb033e4d174baf656fdffae02bcae5ab7560eb35e09ae5f35a93723"}
Jul 23 18:43:28.061867 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:28.061805    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" podStartSLOduration=1.454362856 podStartE2EDuration="2.061788169s" totalImagesPullingTime="607.425313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:28.060805162 +0000 UTC m=+1647.154450577" watchObservedRunningTime="2026-07-23 18:43:28.061788169 +0000 UTC m=+1647.155433634"
Jul 23 18:43:29.025225 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:29.025181    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:35.039969 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:35.039919    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:43:40.084461 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.084424    2562 generic.go:356] "Generic (PLEG): container finished" podID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerID="78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc" exitCode=0
Jul 23 18:43:40.084916 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.084504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerDied","Data":"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"}
Jul 23 18:43:40.084959 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.084927    2562 scope.go:117] "RemoveContainer" containerID="78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"
Jul 23 18:43:40.085959 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.085928    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:40.086059 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.086015    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:40.086117 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:40.086061    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:43:41.005957 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:41.005925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:41.091220 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:41.091187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerStarted","Data":"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"}
Jul 23 18:43:41.506514 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:41.506454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:41.507801 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:41.507775    2562 patch_prober.go:28] interesting pod/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 18:43:41.507931 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:41.507823    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 18:43:42.507533 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:42.507460    2562 patch_prober.go:28] interesting pod/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 18:43:42.507936 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:42.507565    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 18:43:43.506809 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:43.506768    2562 patch_prober.go:28] interesting pod/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 18:43:43.507001 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:43.506833    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 18:43:44.507791 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:44.507746    2562 patch_prober.go:28] interesting pod/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 18:43:44.508202 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:44.507808    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 18:43:45.510992 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:45.510961    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:45.511433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:45.511230    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:43:45.512010 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:43:45.511991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:44:02.544277 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.544243    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:44:02.544884 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.544532    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" podUID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" containerName="maas-api" containerID="cri-o://6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c" gracePeriod=30
Jul 23 18:44:02.800048 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.799988    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:44:02.847634 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.847592    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca\") pod \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") "
Jul 23 18:44:02.847826 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.847648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gckh\" (UniqueName: \"kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh\") pod \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") "
Jul 23 18:44:02.847826 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.847670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls\") pod \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\" (UID: \"ca1ca9e0-6309-4bea-987d-bcb67b55a71d\") "
Jul 23 18:44:02.848049 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.848017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca1ca9e0-6309-4bea-987d-bcb67b55a71d" (UID: "ca1ca9e0-6309-4bea-987d-bcb67b55a71d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:44:02.849950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.849920    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca1ca9e0-6309-4bea-987d-bcb67b55a71d" (UID: "ca1ca9e0-6309-4bea-987d-bcb67b55a71d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:44:02.850073 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.850002    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh" (OuterVolumeSpecName: "kube-api-access-2gckh") pod "ca1ca9e0-6309-4bea-987d-bcb67b55a71d" (UID: "ca1ca9e0-6309-4bea-987d-bcb67b55a71d"). InnerVolumeSpecName "kube-api-access-2gckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:02.948765 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.948730    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:02.948765 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.948759    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gckh\" (UniqueName: \"kubernetes.io/projected/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-kube-api-access-2gckh\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:02.948765 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:02.948770    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca1ca9e0-6309-4bea-987d-bcb67b55a71d-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:03.193781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.193691    2562 generic.go:356] "Generic (PLEG): container finished" podID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" containerID="6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c" exitCode=0
Jul 23 18:44:03.193781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.193732    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"
Jul 23 18:44:03.194033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.193781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" event={"ID":"ca1ca9e0-6309-4bea-987d-bcb67b55a71d","Type":"ContainerDied","Data":"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"}
Jul 23 18:44:03.194033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.193842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs" event={"ID":"ca1ca9e0-6309-4bea-987d-bcb67b55a71d","Type":"ContainerDied","Data":"4f3121850eb033e4d174baf656fdffae02bcae5ab7560eb35e09ae5f35a93723"}
Jul 23 18:44:03.194033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.193873    2562 scope.go:117] "RemoveContainer" containerID="6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"
Jul 23 18:44:03.203395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.203380    2562 scope.go:117] "RemoveContainer" containerID="6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"
Jul 23 18:44:03.203669 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:03.203651    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c\": container with ID starting with 6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c not found: ID does not exist" containerID="6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"
Jul 23 18:44:03.203735 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.203678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c"} err="failed to get container status \"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c\": rpc error: code = NotFound desc = could not find container \"6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c\": container with ID starting with 6959e2a665525149c5a8e1a5d2b8dea5a9abe5f2b7fda06824e5d6c16a09149c not found: ID does not exist"
Jul 23 18:44:03.216879 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.216855    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:44:03.221609 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.221587    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9f5b583d-7bd6b8ccb7-f4qcs"]
Jul 23 18:44:03.575598 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:03.575568    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" path="/var/lib/kubelet/pods/ca1ca9e0-6309-4bea-987d-bcb67b55a71d/volumes"
Jul 23 18:44:07.170171 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:07.170138    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:44:07.170642 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:07.170356    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy" containerID="cri-o://d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a" gracePeriod=30
Jul 23 18:44:08.477429 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.477399    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:08.477872 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.477836    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" containerName="maas-api"
Jul 23 18:44:08.477872 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.477850    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" containerName="maas-api"
Jul 23 18:44:08.477958 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.477936    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca1ca9e0-6309-4bea-987d-bcb67b55a71d" containerName="maas-api"
Jul 23 18:44:08.482203 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.482185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.493050 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.493029    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4dccab9b-gw-openshift-default-dockercfg-jk9p7\""
Jul 23 18:44:08.503075 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503207 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mmbk\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.503416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.503386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.583296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.583262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:08.604581 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604709 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604709 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604709 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604709 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.604935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.604799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mmbk\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.605141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.605076    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.605141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.605096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.605291 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.605265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.605370 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.605316    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.605522 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.605503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.607116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.607098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.607544 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.607528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.619677 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.619645    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.633831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.633810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mmbk\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk\") pod \"e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") " pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.793347 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.793309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:08.958225 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.958193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:08.960259 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:44:08.960235    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052cde2a_4497_46bd_9877_ead7c1e46f62.slice/crio-205591787e6d040db3878df13f40569068b09f4704972d08132e326fd1ce93c1 WatchSource:0}: Error finding container 205591787e6d040db3878df13f40569068b09f4704972d08132e326fd1ce93c1: Status 404 returned error can't find the container with id 205591787e6d040db3878df13f40569068b09f4704972d08132e326fd1ce93c1
Jul 23 18:44:08.962261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.962225    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:08.962345 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.962299    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:08.962383 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:08.962347    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:09.228203 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:09.228114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerStarted","Data":"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"}
Jul 23 18:44:09.228203 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:09.228178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerStarted","Data":"205591787e6d040db3878df13f40569068b09f4704972d08132e326fd1ce93c1"}
Jul 23 18:44:09.254645 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:09.254588    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podStartSLOduration=1.254568579 podStartE2EDuration="1.254568579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:09.253066649 +0000 UTC m=+1688.346712066" watchObservedRunningTime="2026-07-23 18:44:09.254568579 +0000 UTC m=+1688.348213997"
Jul 23 18:44:09.793502 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:09.793444    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:10.799501 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.799450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:10.843146 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.843113    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:10.846762 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.846742    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:10.849713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.849684    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-4dccab9b-serving-cert\""
Jul 23 18:44:10.849825 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.849761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jvms6\""
Jul 23 18:44:10.857654 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.857632    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:10.929859 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.929819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:10.930034 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.929881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:10.930034 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:10.929931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtkxx\" (UniqueName: \"kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.030663 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.030619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.030852 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.030682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.030852 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.030730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtkxx\" (UniqueName: \"kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.030852 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:11.030776    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-serving-cert: secret "maas-api-e2e-migrate-4dccab9b-serving-cert" not found
Jul 23 18:44:11.030852 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:11.030845    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls podName:fc04e45f-a609-4ab7-9c69-034e163a97c3 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:11.530822318 +0000 UTC m=+1690.624467726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls") pod "maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" (UID: "fc04e45f-a609-4ab7-9c69-034e163a97c3") : secret "maas-api-e2e-migrate-4dccab9b-serving-cert" not found
Jul 23 18:44:11.031613 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.031584    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.044454 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.044422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtkxx\" (UniqueName: \"kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.237240 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.237152    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:11.238342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.238319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:11.534781 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.534740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.537292 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.537262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") pod \"maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.758740 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.758706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:11.897387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:11.897363    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:11.898901 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:44:11.898874    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc04e45f_a609_4ab7_9c69_034e163a97c3.slice/crio-08fa239e7507d87aac1e81faac664a8aac770726cf6517b008278bb5625f350f WatchSource:0}: Error finding container 08fa239e7507d87aac1e81faac664a8aac770726cf6517b008278bb5625f350f: Status 404 returned error can't find the container with id 08fa239e7507d87aac1e81faac664a8aac770726cf6517b008278bb5625f350f
Jul 23 18:44:12.243216 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.243191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" event={"ID":"fc04e45f-a609-4ab7-9c69-034e163a97c3","Type":"ContainerStarted","Data":"08fa239e7507d87aac1e81faac664a8aac770726cf6517b008278bb5625f350f"}
Jul 23 18:44:12.432910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.432850    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:44:12.542944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.542908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.542999    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmpzq\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543149    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543190    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543310    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:12.543372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket\") pod \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\" (UID: \"51f08580-39ca-4a16-bc85-0aa2c0c3ad36\") "
Jul 23 18:44:12.543716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543606    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:44:12.543716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543669    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:12.543716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543684    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.543716 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543705    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.543883 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.543719    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.544091 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.544066    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data" (OuterVolumeSpecName: "istio-data") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:12.545341 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.545306    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:44:12.545470 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.545435    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq" (OuterVolumeSpecName: "kube-api-access-rmpzq") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "kube-api-access-rmpzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:12.545740 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.545710    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:12.545740 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.545725    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token" (OuterVolumeSpecName: "istio-token") pod "51f08580-39ca-4a16-bc85-0aa2c0c3ad36" (UID: "51f08580-39ca-4a16-bc85-0aa2c0c3ad36"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:12.644233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644200    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.644233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644225    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.644233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644233    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.644233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644241    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.644593 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644250    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:12.644593 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:12.644259    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmpzq\" (UniqueName: \"kubernetes.io/projected/51f08580-39ca-4a16-bc85-0aa2c0c3ad36-kube-api-access-rmpzq\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:13.249724 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.249685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" event={"ID":"fc04e45f-a609-4ab7-9c69-034e163a97c3","Type":"ContainerStarted","Data":"6db85a6c39cff7362c1e36b3b282ad1713b49bf0a2c46218335983c64fa2ab54"}
Jul 23 18:44:13.250183 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.249848    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:13.251317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.251292    2562 generic.go:356] "Generic (PLEG): container finished" podID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerID="d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a" exitCode=0
Jul 23 18:44:13.251434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.251335    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"
Jul 23 18:44:13.251434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.251371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerDied","Data":"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"}
Jul 23 18:44:13.251434 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.251424    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf" event={"ID":"51f08580-39ca-4a16-bc85-0aa2c0c3ad36","Type":"ContainerDied","Data":"89f6ae13430d0fefa3c5b57389339d5256ee358be28f1fd8ff8095bdaae3cafe"}
Jul 23 18:44:13.251556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.251453    2562 scope.go:117] "RemoveContainer" containerID="d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"
Jul 23 18:44:13.261837 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.261819    2562 scope.go:117] "RemoveContainer" containerID="78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"
Jul 23 18:44:13.270218 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.270146    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" podStartSLOduration=2.9299428560000003 podStartE2EDuration="3.270127895s" totalImagesPullingTime="340.185039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:13.266584119 +0000 UTC m=+1692.360229539" watchObservedRunningTime="2026-07-23 18:44:13.270127895 +0000 UTC m=+1692.363773314"
Jul 23 18:44:13.271395 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.271324    2562 scope.go:117] "RemoveContainer" containerID="d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"
Jul 23 18:44:13.271746 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:13.271726    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a\": container with ID starting with d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a not found: ID does not exist" containerID="d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"
Jul 23 18:44:13.271839 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.271766    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a"} err="failed to get container status \"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a\": rpc error: code = NotFound desc = could not find container \"d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a\": container with ID starting with d3c38d052d8dcdd5c9f0f83c21ec097a0a597cc779cfcee32aa14e8b0abfa93a not found: ID does not exist"
Jul 23 18:44:13.271839 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.271785    2562 scope.go:117] "RemoveContainer" containerID="78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"
Jul 23 18:44:13.272026 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:13.272008    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc\": container with ID starting with 78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc not found: ID does not exist" containerID="78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"
Jul 23 18:44:13.272082 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.272039    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc"} err="failed to get container status \"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc\": rpc error: code = NotFound desc = could not find container \"78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc\": container with ID starting with 78acc0b3fcc3c120d821680fe97f8d052bb5d27f42de3543f93ab9f0e26bacbc not found: ID does not exist"
Jul 23 18:44:13.282329 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.282308    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:44:13.286114 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.286087    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9f5b583d-openshift-default-d95fcc947-pcbpf"]
Jul 23 18:44:13.575232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:13.575198    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" path="/var/lib/kubelet/pods/51f08580-39ca-4a16-bc85-0aa2c0c3ad36/volumes"
Jul 23 18:44:19.263299 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:19.263264    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:25.318947 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.318914    2562 generic.go:356] "Generic (PLEG): container finished" podID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerID="be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda" exitCode=0
Jul 23 18:44:25.319408 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.318977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerDied","Data":"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"}
Jul 23 18:44:25.319408 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.319369    2562 scope.go:117] "RemoveContainer" containerID="be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"
Jul 23 18:44:25.320420 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.320390    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:25.320498 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.320467    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:25.320544 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:25.320520    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:26.237832 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:26.237784    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:26.328891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:26.328850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerStarted","Data":"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"}
Jul 23 18:44:26.794439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:26.794398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:26.795637 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:26.795613    2562 patch_prober.go:28] interesting pod/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 18:44:26.795718 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:26.795665    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 18:44:27.794291 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:27.794248    2562 patch_prober.go:28] interesting pod/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 18:44:27.794737 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:27.794314    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 18:44:28.794346 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:28.794308    2562 patch_prober.go:28] interesting pod/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 18:44:28.794780 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:28.794380    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 18:44:29.793856 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:29.793820    2562 patch_prober.go:28] interesting pod/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 23 18:44:29.794051 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:29.793874    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 23 18:44:30.798550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:30.798521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:30.798996 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:30.798880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:30.799634 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:30.799617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:46.321281 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.321245    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:46.321894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.321444    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" podUID="fc04e45f-a609-4ab7-9c69-034e163a97c3" containerName="maas-api" containerID="cri-o://6db85a6c39cff7362c1e36b3b282ad1713b49bf0a2c46218335983c64fa2ab54" gracePeriod=30
Jul 23 18:44:46.436620 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.436590    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc04e45f-a609-4ab7-9c69-034e163a97c3" containerID="6db85a6c39cff7362c1e36b3b282ad1713b49bf0a2c46218335983c64fa2ab54" exitCode=0
Jul 23 18:44:46.436769 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.436664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" event={"ID":"fc04e45f-a609-4ab7-9c69-034e163a97c3","Type":"ContainerDied","Data":"6db85a6c39cff7362c1e36b3b282ad1713b49bf0a2c46218335983c64fa2ab54"}
Jul 23 18:44:46.576854 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.576794    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:46.767139 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.767105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca\") pod \"fc04e45f-a609-4ab7-9c69-034e163a97c3\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") "
Jul 23 18:44:46.767139 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.767150    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") pod \"fc04e45f-a609-4ab7-9c69-034e163a97c3\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") "
Jul 23 18:44:46.767414 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.767184    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtkxx\" (UniqueName: \"kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx\") pod \"fc04e45f-a609-4ab7-9c69-034e163a97c3\" (UID: \"fc04e45f-a609-4ab7-9c69-034e163a97c3\") "
Jul 23 18:44:46.767531 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.767505    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc04e45f-a609-4ab7-9c69-034e163a97c3" (UID: "fc04e45f-a609-4ab7-9c69-034e163a97c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:44:46.769296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.769270    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc04e45f-a609-4ab7-9c69-034e163a97c3" (UID: "fc04e45f-a609-4ab7-9c69-034e163a97c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:44:46.769416 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.769403    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx" (OuterVolumeSpecName: "kube-api-access-dtkxx") pod "fc04e45f-a609-4ab7-9c69-034e163a97c3" (UID: "fc04e45f-a609-4ab7-9c69-034e163a97c3"). InnerVolumeSpecName "kube-api-access-dtkxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:46.867897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.867805    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc04e45f-a609-4ab7-9c69-034e163a97c3-openshift-service-ca\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:46.867897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.867833    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc04e45f-a609-4ab7-9c69-034e163a97c3-maas-api-tls\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:46.867897 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:46.867847    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtkxx\" (UniqueName: \"kubernetes.io/projected/fc04e45f-a609-4ab7-9c69-034e163a97c3-kube-api-access-dtkxx\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:47.444050 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.444018    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"
Jul 23 18:44:47.444568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.444056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x" event={"ID":"fc04e45f-a609-4ab7-9c69-034e163a97c3","Type":"ContainerDied","Data":"08fa239e7507d87aac1e81faac664a8aac770726cf6517b008278bb5625f350f"}
Jul 23 18:44:47.444568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.444127    2562 scope.go:117] "RemoveContainer" containerID="6db85a6c39cff7362c1e36b3b282ad1713b49bf0a2c46218335983c64fa2ab54"
Jul 23 18:44:47.467756 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.467725    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:47.473802 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.473777    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-4dccab9b-5bb54dcd6-hfm2x"]
Jul 23 18:44:47.574565 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:47.574534    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc04e45f-a609-4ab7-9c69-034e163a97c3" path="/var/lib/kubelet/pods/fc04e45f-a609-4ab7-9c69-034e163a97c3/volumes"
Jul 23 18:44:50.986542 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:50.986504    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:50.986999 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:50.986720    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy" containerID="cri-o://5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a" gracePeriod=30
Jul 23 18:44:51.822542 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.822507    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:44:51.823014 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.822994    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc04e45f-a609-4ab7-9c69-034e163a97c3" containerName="maas-api"
Jul 23 18:44:51.823080 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823019    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc04e45f-a609-4ab7-9c69-034e163a97c3" containerName="maas-api"
Jul 23 18:44:51.823080 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823048    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.823080 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823057    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.823080 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823078    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.823296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823086    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.823296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823168    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc04e45f-a609-4ab7-9c69-034e163a97c3" containerName="maas-api"
Jul 23 18:44:51.823296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823180    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.823296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.823191    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f08580-39ca-4a16-bc85-0aa2c0c3ad36" containerName="istio-proxy"
Jul 23 18:44:51.826864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.826844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.832666 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.832640    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d24ea493-openshift-default-dockercfg-5f6lm\""
Jul 23 18:44:51.859125 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.859095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:44:51.907730 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907908    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.907967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.907956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xv2t\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.908319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.908013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:51.908319 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:51.908038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009380 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009352    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009380 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xv2t\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.009935 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.009820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.010344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.010059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.010344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.010111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.010344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.010218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.010344 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.010303    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.011835 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.011810    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.012111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.012095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.020114 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.020094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xv2t\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.020245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.020163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token\") pod \"e2e-ait-d24ea493-openshift-default-8449684c67-flqbn\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") " pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.137471 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.137381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:52.283142 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.283113    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:44:52.284861 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:44:52.284835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1bf2cc_3236_47fb_a3fe_fc8b17b0125e.slice/crio-8cbc9bca88f8f1721e7cb399005b4c6103fee1a6dd0d6be9c258e395cfa07202 WatchSource:0}: Error finding container 8cbc9bca88f8f1721e7cb399005b4c6103fee1a6dd0d6be9c258e395cfa07202: Status 404 returned error can't find the container with id 8cbc9bca88f8f1721e7cb399005b4c6103fee1a6dd0d6be9c258e395cfa07202
Jul 23 18:44:52.287043 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.287012    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:52.287126 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.287073    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:52.287126 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.287105    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:44:52.470127 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.470030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerStarted","Data":"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"}
Jul 23 18:44:52.470127 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.470085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerStarted","Data":"8cbc9bca88f8f1721e7cb399005b4c6103fee1a6dd0d6be9c258e395cfa07202"}
Jul 23 18:44:52.492806 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:52.492753    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podStartSLOduration=1.492735629 podStartE2EDuration="1.492735629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:52.492179894 +0000 UTC m=+1731.585825337" watchObservedRunningTime="2026-07-23 18:44:52.492735629 +0000 UTC m=+1731.586381045"
Jul 23 18:44:53.137718 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:53.137687    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:53.142398 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:53.142376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:53.474873 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:53.474795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:53.475713 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:53.475693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:44:56.251300 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.251227    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:56.352518 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352534    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352590    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352634    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352860 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mmbk\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352860 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352860 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352860 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352815    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo\") pod \"052cde2a-4497-46bd-9877-ead7c1e46f62\" (UID: \"052cde2a-4497-46bd-9877-ead7c1e46f62\") "
Jul 23 18:44:56.352998 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352879    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:56.352998 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.352929    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:56.353172 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353097    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:56.353229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353185    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.353229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353202    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.353229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353216    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.353382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353289    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:44:56.353667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.353625    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data" (OuterVolumeSpecName: "istio-data") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:56.355025 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.354993    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:44:56.355025 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.355012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:44:56.355167 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.355119    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token" (OuterVolumeSpecName: "istio-token") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:56.355167 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.355122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk" (OuterVolumeSpecName: "kube-api-access-7mmbk") pod "052cde2a-4497-46bd-9877-ead7c1e46f62" (UID: "052cde2a-4497-46bd-9877-ead7c1e46f62"). InnerVolumeSpecName "kube-api-access-7mmbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:44:56.454532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454501    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.454532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454530    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.454532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454541    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.454774 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454549    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/052cde2a-4497-46bd-9877-ead7c1e46f62-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.454774 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454558    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mmbk\" (UniqueName: \"kubernetes.io/projected/052cde2a-4497-46bd-9877-ead7c1e46f62-kube-api-access-7mmbk\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.454774 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.454566    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/052cde2a-4497-46bd-9877-ead7c1e46f62-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:44:56.491511 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.491456    2562 generic.go:356] "Generic (PLEG): container finished" podID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerID="5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a" exitCode=0
Jul 23 18:44:56.491686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.491537    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"
Jul 23 18:44:56.491686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.491540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerDied","Data":"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"}
Jul 23 18:44:56.491686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.491603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk" event={"ID":"052cde2a-4497-46bd-9877-ead7c1e46f62","Type":"ContainerDied","Data":"205591787e6d040db3878df13f40569068b09f4704972d08132e326fd1ce93c1"}
Jul 23 18:44:56.491686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.491626    2562 scope.go:117] "RemoveContainer" containerID="5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"
Jul 23 18:44:56.502249 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.502231    2562 scope.go:117] "RemoveContainer" containerID="be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"
Jul 23 18:44:56.510730 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.510712    2562 scope.go:117] "RemoveContainer" containerID="5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"
Jul 23 18:44:56.510987 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:56.510968    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a\": container with ID starting with 5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a not found: ID does not exist" containerID="5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"
Jul 23 18:44:56.511063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.511000    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a"} err="failed to get container status \"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a\": rpc error: code = NotFound desc = could not find container \"5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a\": container with ID starting with 5fcc8ca7b1f39372e66176ac605834f75b051b8e3789ff06819ec84285100e0a not found: ID does not exist"
Jul 23 18:44:56.511063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.511027    2562 scope.go:117] "RemoveContainer" containerID="be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"
Jul 23 18:44:56.511285 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:44:56.511267    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda\": container with ID starting with be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda not found: ID does not exist" containerID="be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"
Jul 23 18:44:56.511328 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.511291    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda"} err="failed to get container status \"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda\": rpc error: code = NotFound desc = could not find container \"be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda\": container with ID starting with be099201a1868970c7fddf416f8ab0cff36e880f924d5e7294f1e0135c9e6eda not found: ID does not exist"
Jul 23 18:44:56.516088 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.516066    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:56.520243 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:56.520221    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4dccab9b-gw-openshift-default-845457869f-dtdfk"]
Jul 23 18:44:57.574597 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:44:57.574561    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" path="/var/lib/kubelet/pods/052cde2a-4497-46bd-9877-ead7c1e46f62/volumes"
Jul 23 18:45:08.476971 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.476883    2562 patch_prober.go:28] interesting pod/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 18:45:08.476971 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.476948    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 18:45:08.556394 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.556359    2562 generic.go:356] "Generic (PLEG): container finished" podID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerID="5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c" exitCode=0
Jul 23 18:45:08.556600 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.556407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerDied","Data":"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"}
Jul 23 18:45:08.556843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.556828    2562 scope.go:117] "RemoveContainer" containerID="5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"
Jul 23 18:45:08.557826 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.557797    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:08.557890 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.557867    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:08.557934 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:08.557899    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:09.563922 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:09.563890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerStarted","Data":"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"}
Jul 23 18:45:10.138783 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:10.138294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:10.138783 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:10.138419    2562 patch_prober.go:28] interesting pod/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 18:45:10.138783 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:10.138515    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 18:45:11.138769 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:11.138723    2562 patch_prober.go:28] interesting pod/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 18:45:11.139323 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:11.138798    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 18:45:12.137891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:12.137849    2562 patch_prober.go:28] interesting pod/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 18:45:12.138219 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:12.138191    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 18:45:13.138357 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:13.138310    2562 patch_prober.go:28] interesting pod/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 23 18:45:13.138895 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:13.138400    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 23 18:45:14.142257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:14.142216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:14.142667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:14.142584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:14.143379 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:14.143362    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:35.923916 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:35.923876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:45:35.924523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:35.924139    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy" containerID="cri-o://3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933" gracePeriod=30
Jul 23 18:45:36.656116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656081    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:45:36.656449 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656437    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.656506 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656452    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.656506 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656462    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.656506 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.656604 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656552    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.656604 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.656559    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="052cde2a-4497-46bd-9877-ead7c1e46f62" containerName="istio-proxy"
Jul 23 18:45:36.659525 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.659499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.663378 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.663353    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0a3d054e-openshift-default-dockercfg-274zp\""
Jul 23 18:45:36.674170 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.674140    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:45:36.730682 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.730880 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.730880 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.730880 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.731055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.731055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jfjj\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.731055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.730991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.731055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.731015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.731185 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.731053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.831925 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.831885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jfjj\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.831934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.831950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.831966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832078    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832140 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832569 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832569 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832684 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832896 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.832961 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.832933    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.834527 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.834505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.834882 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.834862    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.841159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.840888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jfjj\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.841536 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.841514    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token\") pod \"e2e-derive-0a3d054e-openshift-default-646d848895-px8zh\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") " pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:36.970621 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:36.970525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:37.119890 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.119865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:45:37.121590 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:45:37.121560    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e884455_9df5_46b4_8daf_56a8db0db99b.slice/crio-4852a94a0c8c14ed8c4ad945a35d027e8bc1ef2adaead661a4d61e6bfc2b8fbc WatchSource:0}: Error finding container 4852a94a0c8c14ed8c4ad945a35d027e8bc1ef2adaead661a4d61e6bfc2b8fbc: Status 404 returned error can't find the container with id 4852a94a0c8c14ed8c4ad945a35d027e8bc1ef2adaead661a4d61e6bfc2b8fbc
Jul 23 18:45:37.123999 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.123959    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:37.124109 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.124032    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:37.124109 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.124060    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:37.694960 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.694927    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerStarted","Data":"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"}
Jul 23 18:45:37.694960 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.694978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerStarted","Data":"4852a94a0c8c14ed8c4ad945a35d027e8bc1ef2adaead661a4d61e6bfc2b8fbc"}
Jul 23 18:45:37.722166 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.722115    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podStartSLOduration=1.722099975 podStartE2EDuration="1.722099975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:37.719985048 +0000 UTC m=+1776.813630467" watchObservedRunningTime="2026-07-23 18:45:37.722099975 +0000 UTC m=+1776.815745392"
Jul 23 18:45:37.971052 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:37.970958    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:38.976668 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:38.976634    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:39.704107 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:39.704079    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:39.704999 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:39.704976    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:41.179190 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.179156    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:41.272188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272152    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272227    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272250    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272284    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xv2t\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272451    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data\") pod \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\" (UID: \"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e\") "
Jul 23 18:45:41.272697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:45:41.272697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272623    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:45:41.272954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272854    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.272954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272872    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.272954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:45:41.273112 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.272964    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:45:41.273225 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.273206    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:45:41.274787 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.274759    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:45:41.274883 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.274852    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:45:41.274954 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.274939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:45:41.274995 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.274960    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t" (OuterVolumeSpecName: "kube-api-access-5xv2t") pod "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" (UID: "8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e"). InnerVolumeSpecName "kube-api-access-5xv2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:45:41.374155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374116    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xv2t\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-kube-api-access-5xv2t\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374148    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374157    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374165    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374173    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374181    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.374422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.374187    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:45:41.715156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.715123    2562 generic.go:356] "Generic (PLEG): container finished" podID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerID="3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933" exitCode=0
Jul 23 18:45:41.715337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.715174    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"
Jul 23 18:45:41.715337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.715208    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerDied","Data":"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"}
Jul 23 18:45:41.715337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.715265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn" event={"ID":"8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e","Type":"ContainerDied","Data":"8cbc9bca88f8f1721e7cb399005b4c6103fee1a6dd0d6be9c258e395cfa07202"}
Jul 23 18:45:41.715337 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.715293    2562 scope.go:117] "RemoveContainer" containerID="3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"
Jul 23 18:45:41.724554 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.724534    2562 scope.go:117] "RemoveContainer" containerID="5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"
Jul 23 18:45:41.732632 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.732613    2562 scope.go:117] "RemoveContainer" containerID="3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"
Jul 23 18:45:41.732892 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:45:41.732871    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933\": container with ID starting with 3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933 not found: ID does not exist" containerID="3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"
Jul 23 18:45:41.732956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.732904    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933"} err="failed to get container status \"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933\": rpc error: code = NotFound desc = could not find container \"3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933\": container with ID starting with 3b14542049fc46765fcfc1e0583713336ef70640a7aa2acdea7319bb7c718933 not found: ID does not exist"
Jul 23 18:45:41.732956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.732924    2562 scope.go:117] "RemoveContainer" containerID="5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"
Jul 23 18:45:41.733144 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:45:41.733129    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c\": container with ID starting with 5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c not found: ID does not exist" containerID="5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"
Jul 23 18:45:41.733186 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.733148    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c"} err="failed to get container status \"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c\": rpc error: code = NotFound desc = could not find container \"5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c\": container with ID starting with 5fb4063320f52398b209ffeb66f440cd62c9e69d5352591a441e218d726aaa4c not found: ID does not exist"
Jul 23 18:45:41.737277 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.737255    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:45:41.743950 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:41.743921    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d24ea493-openshift-default-8449684c67-flqbn"]
Jul 23 18:45:43.574973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:43.574941    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" path="/var/lib/kubelet/pods/8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e/volumes"
Jul 23 18:45:53.783575 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.783542    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerID="4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5" exitCode=0
Jul 23 18:45:53.783985 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.783581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerDied","Data":"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"}
Jul 23 18:45:53.784027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.783990    2562 scope.go:117] "RemoveContainer" containerID="4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"
Jul 23 18:45:53.785040 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.785008    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:53.785152 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.785104    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:53.785220 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:53.785155    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:45:54.704297 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:54.704267    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:54.790876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:54.790844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerStarted","Data":"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"}
Jul 23 18:45:54.970873 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:54.970779    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:54.972102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:54.972067    2562 patch_prober.go:28] interesting pod/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:45:54.972243 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:54.972122    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 18:45:55.970831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:55.970796    2562 patch_prober.go:28] interesting pod/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:45:55.971217 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:55.970850    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 18:45:56.971771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:56.971726    2562 patch_prober.go:28] interesting pod/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:45:56.972160 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:56.971809    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 18:45:57.971657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:57.971615    2562 patch_prober.go:28] interesting pod/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:45:57.971876 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:57.971696    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 18:45:58.974757 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:58.974721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:58.975156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:58.974986    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:45:58.975700 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:45:58.975684    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:46:19.206090 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:19.206051    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:46:19.206573 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:19.206320    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy" containerID="cri-o://f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871" gracePeriod=30
Jul 23 18:46:24.464452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.464417    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:46:24.476920 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.476854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.476920 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.476890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.476920 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.476921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.476948    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jfjj\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477057    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477095    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.477439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477158    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:24.477439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:24.477439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477253    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:24.477630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477439    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.477630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477458    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.477630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477473    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.477630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.477494    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:46:24.478053 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.478030    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:24.479353 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.479333    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:46:24.479499 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.479457    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:46:24.479547 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.479473    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj" (OuterVolumeSpecName: "kube-api-access-7jfjj") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "kube-api-access-7jfjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:46:24.578473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578436    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token\") pod \"8e884455-9df5-46b4-8daf-56a8db0db99b\" (UID: \"8e884455-9df5-46b4-8daf-56a8db0db99b\") "
Jul 23 18:46:24.578686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578644    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jfjj\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-kube-api-access-7jfjj\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.578686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578658    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.578686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578667    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.578686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578676    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e884455-9df5-46b4-8daf-56a8db0db99b-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.578686 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.578684    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.580558 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.580531    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e884455-9df5-46b4-8daf-56a8db0db99b" (UID: "8e884455-9df5-46b4-8daf-56a8db0db99b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:46:24.679615 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.679577    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e884455-9df5-46b4-8daf-56a8db0db99b-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:46:24.932071 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.932033    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerID="f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871" exitCode=0
Jul 23 18:46:24.932245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.932084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerDied","Data":"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"}
Jul 23 18:46:24.932245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.932095    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"
Jul 23 18:46:24.932245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.932140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh" event={"ID":"8e884455-9df5-46b4-8daf-56a8db0db99b","Type":"ContainerDied","Data":"4852a94a0c8c14ed8c4ad945a35d027e8bc1ef2adaead661a4d61e6bfc2b8fbc"}
Jul 23 18:46:24.932245 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.932170    2562 scope.go:117] "RemoveContainer" containerID="f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"
Jul 23 18:46:24.942100 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.942079    2562 scope.go:117] "RemoveContainer" containerID="4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"
Jul 23 18:46:24.949813 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.949790    2562 scope.go:117] "RemoveContainer" containerID="f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"
Jul 23 18:46:24.950107 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:46:24.950085    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871\": container with ID starting with f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871 not found: ID does not exist" containerID="f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"
Jul 23 18:46:24.950198 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.950111    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871"} err="failed to get container status \"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871\": rpc error: code = NotFound desc = could not find container \"f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871\": container with ID starting with f12b1603cdd95c3bf99e9b678100c14c2497916c4c595441fd3f243c03226871 not found: ID does not exist"
Jul 23 18:46:24.950198 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.950127    2562 scope.go:117] "RemoveContainer" containerID="4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"
Jul 23 18:46:24.950363 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:46:24.950344    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5\": container with ID starting with 4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5 not found: ID does not exist" containerID="4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"
Jul 23 18:46:24.950421 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.950375    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5"} err="failed to get container status \"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5\": rpc error: code = NotFound desc = could not find container \"4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5\": container with ID starting with 4bcecf6d02083d9e7ced9471e20d4015ef199d5f5774d8d26ae51f0bab85bff5 not found: ID does not exist"
Jul 23 18:46:24.959572 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.959547    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:46:24.961703 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:24.961680    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0a3d054e-openshift-default-646d848895-px8zh"]
Jul 23 18:46:25.576112 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:46:25.576077    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" path="/var/lib/kubelet/pods/8e884455-9df5-46b4-8daf-56a8db0db99b/volumes"
Jul 23 18:48:03.012676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.012637    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.012989    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013000    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013007    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013013    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013029    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013034    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013052    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.013095 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013060    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.013342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013128    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:48:03.013342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013137    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.013342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.013144    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1bf2cc-3236-47fb-a3fe-fc8b17b0125e" containerName="istio-proxy"
Jul 23 18:48:03.016071 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.016052    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.019075 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.019056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-4ce7c7da-openshift-default-dockercfg-6zfff\""
Jul 23 18:48:03.040473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.040449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:03.155071 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.155646 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.155470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzdw8\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.255996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzdw8\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256565 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256603 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256581    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.256908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.257043 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.256968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.257043 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.257015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.257125 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.257073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.258630 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.258609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.258758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.258737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.269834 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.269806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.269929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.269875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzdw8\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8\") pod \"e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") " pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.326604 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.326567    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:03.504341 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.504314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:03.507010 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:48:03.506979    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae828f4e_3566_41d4_9b61_7c1873414cf5.slice/crio-72480c023446a2ece7f3b83bf1661685c4c46438a6c046610af16de601037db1 WatchSource:0}: Error finding container 72480c023446a2ece7f3b83bf1661685c4c46438a6c046610af16de601037db1: Status 404 returned error can't find the container with id 72480c023446a2ece7f3b83bf1661685c4c46438a6c046610af16de601037db1
Jul 23 18:48:03.509096 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.509061    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:03.509176 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.509128    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:03.509176 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:03.509159    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:04.397729 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:04.397696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerStarted","Data":"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"}
Jul 23 18:48:04.398143 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:04.397750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerStarted","Data":"72480c023446a2ece7f3b83bf1661685c4c46438a6c046610af16de601037db1"}
Jul 23 18:48:04.422990 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:04.422939    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podStartSLOduration=2.422923491 podStartE2EDuration="2.422923491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:48:04.420033039 +0000 UTC m=+1923.513678469" watchObservedRunningTime="2026-07-23 18:48:04.422923491 +0000 UTC m=+1923.516568928"
Jul 23 18:48:05.326944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:05.326902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:05.332017 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:05.331989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:05.402709 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:05.402683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:05.403571 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:05.403555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:17.470552 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.470520    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerID="e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0" exitCode=0
Jul 23 18:48:17.470552 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.470557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerDied","Data":"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"}
Jul 23 18:48:17.471038 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.470945    2562 scope.go:117] "RemoveContainer" containerID="e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"
Jul 23 18:48:17.471929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.471891    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:17.472033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.471965    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:17.472033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:17.471997    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:48:18.477150 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:18.477114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerStarted","Data":"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"}
Jul 23 18:48:19.327188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:19.327152    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:19.328767 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:19.328738    2562 patch_prober.go:28] interesting pod/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 18:48:19.328999 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:19.328972    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 18:48:20.327812 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:20.327768    2562 patch_prober.go:28] interesting pod/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 18:48:20.328324 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:20.327843    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 18:48:20.403269 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:20.403239    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:21.327953 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:21.327918    2562 patch_prober.go:28] interesting pod/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 18:48:21.328558 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:21.328525    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 18:48:22.327349 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:22.327312    2562 patch_prober.go:28] interesting pod/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 23 18:48:22.327669 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:22.327634    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 23 18:48:23.331456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:23.331421    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:23.332563 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:23.332542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:40.151865 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:40.151823    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:40.152373 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:40.152066    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy" containerID="cri-o://10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda" gracePeriod=30
Jul 23 18:48:45.399938 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.399912    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:45.536967 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.536935    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.536974    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.536998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzdw8\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537021    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537070    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537094    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537112    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537159 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537165    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy\") pod \"ae828f4e-3566-41d4-9b61-7c1873414cf5\" (UID: \"ae828f4e-3566-41d4-9b61-7c1873414cf5\") "
Jul 23 18:48:45.537578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537295    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:45.537578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537416    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:48:45.537578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537424    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:45.537578 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537527    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:45.537848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537614    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.537848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537635    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.537848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537644    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.537848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.537652    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae828f4e-3566-41d4-9b61-7c1873414cf5-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.538170 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.538148    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:45.539424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.539399    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8" (OuterVolumeSpecName: "kube-api-access-hzdw8") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "kube-api-access-hzdw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:48:45.539424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.539410    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:48:45.539696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.539669    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:48:45.539696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.539676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae828f4e-3566-41d4-9b61-7c1873414cf5" (UID: "ae828f4e-3566-41d4-9b61-7c1873414cf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:48:45.606276 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.606243    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerID="10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda" exitCode=0
Jul 23 18:48:45.606400 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.606292    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"
Jul 23 18:48:45.606400 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.606332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerDied","Data":"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"}
Jul 23 18:48:45.606400 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.606387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz" event={"ID":"ae828f4e-3566-41d4-9b61-7c1873414cf5","Type":"ContainerDied","Data":"72480c023446a2ece7f3b83bf1661685c4c46438a6c046610af16de601037db1"}
Jul 23 18:48:45.606518 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.606409    2562 scope.go:117] "RemoveContainer" containerID="10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"
Jul 23 18:48:45.614809 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.614783    2562 scope.go:117] "RemoveContainer" containerID="e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"
Jul 23 18:48:45.622345 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.622327    2562 scope.go:117] "RemoveContainer" containerID="10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"
Jul 23 18:48:45.622608 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:48:45.622591    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda\": container with ID starting with 10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda not found: ID does not exist" containerID="10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"
Jul 23 18:48:45.622677 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.622615    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda"} err="failed to get container status \"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda\": rpc error: code = NotFound desc = could not find container \"10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda\": container with ID starting with 10872ca3701a4b334e770a00a40c0af92e12f352f125b8403016744bdadebdda not found: ID does not exist"
Jul 23 18:48:45.622677 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.622630    2562 scope.go:117] "RemoveContainer" containerID="e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"
Jul 23 18:48:45.622876 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:48:45.622859    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0\": container with ID starting with e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0 not found: ID does not exist" containerID="e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"
Jul 23 18:48:45.622930 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.622885    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0"} err="failed to get container status \"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0\": rpc error: code = NotFound desc = could not find container \"e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0\": container with ID starting with e84f1e30a528625f13ea71aea9e4dc92469bfdba24f94fd4ab0d687e62dffeb0 not found: ID does not exist"
Jul 23 18:48:45.625927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.625907    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:45.628520 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.628500    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-4ce7c7da-openshift-default-58f5b56847-lr5fz"]
Jul 23 18:48:45.638328 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.638313    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzdw8\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-kube-api-access-hzdw8\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.638388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.638331    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.638388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.638341    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.638388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.638349    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:45.638388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:45.638357    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae828f4e-3566-41d4-9b61-7c1873414cf5-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:48:47.575133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:48:47.575101    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" path="/var/lib/kubelet/pods/ae828f4e-3566-41d4-9b61-7c1873414cf5/volumes"
Jul 23 18:49:00.180228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180147    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:49:00.180690 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180675    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:49:00.180690 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180692    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:49:00.180786 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180713    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:49:00.180786 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180718    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:49:00.180786 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180770    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:49:00.180786 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.180778    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e884455-9df5-46b4-8daf-56a8db0db99b" containerName="istio-proxy"
Jul 23 18:49:00.185101 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.185080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.187930 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.187907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3d6a5d58-openshift-default-dockercfg-ftq7f\""
Jul 23 18:49:00.198222 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.198201    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:49:00.264777 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.264951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.264951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.264951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.264951 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.265133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.264980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfspc\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.265133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.265010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.265133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.265033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.265133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.265049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366071 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366071 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366646 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfspc\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366646 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.366831 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.366812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.367142 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.367121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.367217 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.367152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.367217 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.367202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.367528 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.367471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.368742 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.368720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.369198 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.369180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.375457 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.375435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfspc\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.375602 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.375510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token\") pod \"e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") " pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.496067 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.495984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:00.635234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.635204    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:49:00.637791 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:49:00.637754    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136b2ec5_b2ec_44c0_ad09_52ad1ce0c028.slice/crio-872bda4c9fd4f3979dca82654ae2e43ab3025e04a4c6e2d0280e1e24b9182a63 WatchSource:0}: Error finding container 872bda4c9fd4f3979dca82654ae2e43ab3025e04a4c6e2d0280e1e24b9182a63: Status 404 returned error can't find the container with id 872bda4c9fd4f3979dca82654ae2e43ab3025e04a4c6e2d0280e1e24b9182a63
Jul 23 18:49:00.640376 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.640343    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:00.640467 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.640409    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:00.640467 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.640435    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:00.675164 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:00.675134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerStarted","Data":"872bda4c9fd4f3979dca82654ae2e43ab3025e04a4c6e2d0280e1e24b9182a63"}
Jul 23 18:49:01.681535 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:01.681468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerStarted","Data":"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"}
Jul 23 18:49:01.711564 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:01.711515    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podStartSLOduration=1.7115004090000001 podStartE2EDuration="1.711500409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:49:01.709549313 +0000 UTC m=+1980.803194758" watchObservedRunningTime="2026-07-23 18:49:01.711500409 +0000 UTC m=+1980.805145873"
Jul 23 18:49:02.496796 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:02.496756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:02.501625 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:02.501600    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:02.686412 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:02.686381    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:02.687390 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:02.687374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:18.727657 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:18.727618    2562 patch_prober.go:28] interesting pod/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 18:49:18.728163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:18.727706    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 18:49:19.784837 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.784804    2562 generic.go:356] "Generic (PLEG): container finished" podID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerID="7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5" exitCode=0
Jul 23 18:49:19.785273 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.784860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerDied","Data":"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"}
Jul 23 18:49:19.785273 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.785212    2562 scope.go:117] "RemoveContainer" containerID="7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"
Jul 23 18:49:19.786228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.786198    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:19.786327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.786281    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:19.786327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:19.786318    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:49:20.792972 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:20.792932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerStarted","Data":"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"}
Jul 23 18:49:21.496565 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:21.496521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:21.496814 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:21.496788    2562 patch_prober.go:28] interesting pod/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:49:21.496864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:21.496842    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 18:49:22.497102 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:22.497054    2562 patch_prober.go:28] interesting pod/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:49:22.497649 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:22.497112    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 18:49:23.496944 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:23.496905    2562 patch_prober.go:28] interesting pod/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:49:23.497123 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:23.496965    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 18:49:24.496573 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:24.496535    2562 patch_prober.go:28] interesting pod/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 18:49:24.496974 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:24.496593    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 18:49:25.500108 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:25.500073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:25.500602 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:25.500454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:49:25.501041 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:49:25.501026    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:51:03.567819 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:03.567786    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:51:03.568288 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:03.568044    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy" containerID="cri-o://d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d" gracePeriod=30
Jul 23 18:51:08.819363 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.819338    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:51:08.918697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918608    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918649    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918704    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.918927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.919234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918956    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfspc\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.919234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.918989    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data\") pod \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\" (UID: \"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028\") "
Jul 23 18:51:08.919234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919020    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:08.919234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:08.919437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919235    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:08.919437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919260    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:51:08.919437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919314    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:08.919437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919336    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:08.919437 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919350    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:08.919853 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.919833    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data" (OuterVolumeSpecName: "istio-data") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:08.921030 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.921000    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:51:08.921139 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.921062    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc" (OuterVolumeSpecName: "kube-api-access-pfspc") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "kube-api-access-pfspc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:51:08.921241 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.921222    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:51:08.921301 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:08.921285    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token" (OuterVolumeSpecName: "istio-token") pod "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" (UID: "136b2ec5-b2ec-44c0-ad09-52ad1ce0c028"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:51:09.020738 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020714    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfspc\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-kube-api-access-pfspc\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.020738 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020736    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.020894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020745    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.020894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.020894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020761    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.020894 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.020771    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:51:09.306651 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.306620    2562 generic.go:356] "Generic (PLEG): container finished" podID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerID="d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d" exitCode=0
Jul 23 18:51:09.306829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.306671    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"
Jul 23 18:51:09.306829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.306678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerDied","Data":"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"}
Jul 23 18:51:09.306829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.306743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p" event={"ID":"136b2ec5-b2ec-44c0-ad09-52ad1ce0c028","Type":"ContainerDied","Data":"872bda4c9fd4f3979dca82654ae2e43ab3025e04a4c6e2d0280e1e24b9182a63"}
Jul 23 18:51:09.306829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.306785    2562 scope.go:117] "RemoveContainer" containerID="d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"
Jul 23 18:51:09.316723 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.316706    2562 scope.go:117] "RemoveContainer" containerID="7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"
Jul 23 18:51:09.324702 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.324682    2562 scope.go:117] "RemoveContainer" containerID="d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"
Jul 23 18:51:09.324987 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:51:09.324967    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d\": container with ID starting with d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d not found: ID does not exist" containerID="d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"
Jul 23 18:51:09.325063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.324994    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d"} err="failed to get container status \"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d\": rpc error: code = NotFound desc = could not find container \"d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d\": container with ID starting with d5c37e66308e8384f96a8bd6386046ca0120d646e3e7a7517d55ca8a5d4b7a6d not found: ID does not exist"
Jul 23 18:51:09.325063 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.325013    2562 scope.go:117] "RemoveContainer" containerID="7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"
Jul 23 18:51:09.325284 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:51:09.325262    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5\": container with ID starting with 7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5 not found: ID does not exist" containerID="7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"
Jul 23 18:51:09.325336 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.325292    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5"} err="failed to get container status \"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5\": rpc error: code = NotFound desc = could not find container \"7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5\": container with ID starting with 7d82839dc5b16b16b04a90a58044d319b5591c5d60740a73da2c600783779ee5 not found: ID does not exist"
Jul 23 18:51:09.333697 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.333676    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:51:09.338829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.338807    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3d6a5d58-openshift-default-6f875b64ff-5h74p"]
Jul 23 18:51:09.575062 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:51:09.574983    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" path="/var/lib/kubelet/pods/136b2ec5-b2ec-44c0-ad09-52ad1ce0c028/volumes"
Jul 23 18:52:00.174614 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.174383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:52:00.176119 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.176089    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:00.176297 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.176285    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:00.176685 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.176669    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:00.176811 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.176800    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:00.176892 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.176882    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae828f4e-3566-41d4-9b61-7c1873414cf5" containerName="istio-proxy"
Jul 23 18:52:00.181013 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.180991    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.184887 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.184868    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e16158-openshift-default-dockercfg-7thnc\""
Jul 23 18:52:00.203488 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.203443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:52:00.272235 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhrkj\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272701 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272701 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.272701 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.272575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.373688 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.373884 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.373884 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.373884 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.373884 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374108 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374108 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhrkj\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374108 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374108 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.373989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.374104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374342 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.374128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374455 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.374377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374455 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.374429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.374827 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.374803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.376188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.376162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.376514 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.376494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.383798 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.383764    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.386193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.386168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhrkj\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj\") pod \"e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") " pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.492602 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.492503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:00.638304 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.638264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:52:00.638911 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:52:00.638886    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8e2c29_aff7_4bda_8a7c_b882ef82c99a.slice/crio-7054ef9c29aed889ba90761d942e4bb0b72a3768dc3f7f43fb2eb567a3ed2b12 WatchSource:0}: Error finding container 7054ef9c29aed889ba90761d942e4bb0b72a3768dc3f7f43fb2eb567a3ed2b12: Status 404 returned error can't find the container with id 7054ef9c29aed889ba90761d942e4bb0b72a3768dc3f7f43fb2eb567a3ed2b12
Jul 23 18:52:00.641019 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.640975    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:00.641116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.641054    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:00.641116 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:00.641082    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:01.547992 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:01.547954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerStarted","Data":"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"}
Jul 23 18:52:01.548387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:01.548010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerStarted","Data":"7054ef9c29aed889ba90761d942e4bb0b72a3768dc3f7f43fb2eb567a3ed2b12"}
Jul 23 18:52:01.575314 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:01.575251    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podStartSLOduration=1.575235026 podStartE2EDuration="1.575235026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:52:01.57264525 +0000 UTC m=+2160.666290691" watchObservedRunningTime="2026-07-23 18:52:01.575235026 +0000 UTC m=+2160.668880447"
Jul 23 18:52:02.492845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:02.492802    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:02.497980 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:02.497954    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:02.552718 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:02.552680    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:02.553685 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:02.553668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:08.751129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.750674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:52:08.751775 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.751226    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:08.751775 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.751241    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="136b2ec5-b2ec-44c0-ad09-52ad1ce0c028" containerName="istio-proxy"
Jul 23 18:52:08.754747 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.754725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.758037 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.758018    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-aa7092-openshift-default-dockercfg-8wjnj\""
Jul 23 18:52:08.770623 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.770594    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:52:08.857130 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857130 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44xc6\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857439 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857745 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.857745 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.857541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.958802 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958862    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.958982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44xc6\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959002 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959473 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959612 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959667 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959642    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.959820 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.959803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.961623 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.961599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.961875 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.961856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.969638 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.969616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:08.969727 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:08.969704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44xc6\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6\") pod \"e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") " pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:09.065556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.065518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:09.208510 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.208469    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:52:09.210932 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:52:09.210905    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb01f02b_e02a_4838_9388_bd138e8220ba.slice/crio-033adf04932b4302220039c8cecd7f67f4fbfac346f1b1367284beef349bb0eb WatchSource:0}: Error finding container 033adf04932b4302220039c8cecd7f67f4fbfac346f1b1367284beef349bb0eb: Status 404 returned error can't find the container with id 033adf04932b4302220039c8cecd7f67f4fbfac346f1b1367284beef349bb0eb
Jul 23 18:52:09.213115 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.213079    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:09.213221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.213163    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:09.213221 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.213207    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:09.588393 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.588348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerStarted","Data":"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"}
Jul 23 18:52:09.588607 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.588417    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerStarted","Data":"033adf04932b4302220039c8cecd7f67f4fbfac346f1b1367284beef349bb0eb"}
Jul 23 18:52:09.614760 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:09.614703    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podStartSLOduration=1.6146849699999999 podStartE2EDuration="1.61468497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:52:09.612460332 +0000 UTC m=+2168.706105795" watchObservedRunningTime="2026-07-23 18:52:09.61468497 +0000 UTC m=+2168.708330386"
Jul 23 18:52:10.066215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:10.066173    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:10.067835 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:10.067805    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:52:10.067949 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:10.067868    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 18:52:11.070089 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:11.070052    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:11.598257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:11.598227    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:11.599077 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:11.599060    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:17.554258 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.554221    2562 patch_prober.go:28] interesting pod/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 18:52:17.554727 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.554289    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 18:52:17.635455 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.635417    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerID="deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7" exitCode=0
Jul 23 18:52:17.635722 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.635504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerDied","Data":"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"}
Jul 23 18:52:17.636351 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.636332    2562 scope.go:117] "RemoveContainer" containerID="deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"
Jul 23 18:52:17.638613 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.637824    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:17.638613 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.637912    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:17.638613 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:17.637958    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:18.645357 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:18.645322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerStarted","Data":"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"}
Jul 23 18:52:19.493057 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:19.493026    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:19.493242 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:19.493176    2562 patch_prober.go:28] interesting pod/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 18:52:19.493242 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:19.493215    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 18:52:20.493606 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:20.493574    2562 patch_prober.go:28] interesting pod/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 18:52:20.494074 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:20.494049    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 18:52:21.493081 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:21.493042    2562 patch_prober.go:28] interesting pod/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 18:52:21.493279 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:21.493100    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 18:52:22.493843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:22.493797    2562 patch_prober.go:28] interesting pod/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Jul 23 18:52:22.494347 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:22.493860    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Jul 23 18:52:23.497355 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:23.497319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:23.497784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:23.497722    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:23.498367 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:23.498346    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:52:25.690387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.690353    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerID="65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362" exitCode=0
Jul 23 18:52:25.690848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.690413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerDied","Data":"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"}
Jul 23 18:52:25.690848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.690818    2562 scope.go:117] "RemoveContainer" containerID="65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"
Jul 23 18:52:25.691938 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.691908    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:25.692010 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.691993    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:25.692047 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:25.692029    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:52:26.598278 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:26.598236    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:26.697100 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:26.697062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerStarted","Data":"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"}
Jul 23 18:52:27.065921 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:27.065890    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:27.066996 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:27.066963    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:52:27.067133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:27.067033    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 18:52:28.066901 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:28.066860    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:52:28.067332 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:28.066946    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 18:52:29.066036 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:29.065994    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:52:29.066248 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:29.066067    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 18:52:30.066848 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:30.066815    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 18:52:30.067351 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:30.067324    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 18:52:31.070432 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:31.070397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:31.070902 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:31.070782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:52:31.071676 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:52:31.071659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:54:08.921072 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:08.921038    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:54:08.921664 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:08.921249    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy" containerID="cri-o://fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77" gracePeriod=30
Jul 23 18:54:14.179799 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.179774    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:54:14.207949 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.207862    2562 generic.go:356] "Generic (PLEG): container finished" podID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerID="fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77" exitCode=0
Jul 23 18:54:14.207949 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.207911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerDied","Data":"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"}
Jul 23 18:54:14.207949 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.207921    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"
Jul 23 18:54:14.208215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.207958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz" event={"ID":"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a","Type":"ContainerDied","Data":"7054ef9c29aed889ba90761d942e4bb0b72a3768dc3f7f43fb2eb567a3ed2b12"}
Jul 23 18:54:14.208215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.207982    2562 scope.go:117] "RemoveContainer" containerID="fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"
Jul 23 18:54:14.216683 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.216663    2562 scope.go:117] "RemoveContainer" containerID="deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"
Jul 23 18:54:14.226390 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.226369    2562 scope.go:117] "RemoveContainer" containerID="fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"
Jul 23 18:54:14.226699 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:54:14.226680    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77\": container with ID starting with fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77 not found: ID does not exist" containerID="fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"
Jul 23 18:54:14.226789 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.226712    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77"} err="failed to get container status \"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77\": rpc error: code = NotFound desc = could not find container \"fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77\": container with ID starting with fc97dadf3449818281f369a46f8ebf6dbc6b17468797c21af5dc254d7fe93e77 not found: ID does not exist"
Jul 23 18:54:14.226789 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.226739    2562 scope.go:117] "RemoveContainer" containerID="deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"
Jul 23 18:54:14.226986 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:54:14.226969    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7\": container with ID starting with deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7 not found: ID does not exist" containerID="deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"
Jul 23 18:54:14.227043 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.226993    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7"} err="failed to get container status \"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7\": rpc error: code = NotFound desc = could not find container \"deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7\": container with ID starting with deb8e79d775c62a6333e7cf028f6c7631c055902b717dfe4db475ea54b5d76b7 not found: ID does not exist"
Jul 23 18:54:14.259333 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259298    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259348    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259521    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhrkj\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259878 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259612    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259878 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259878 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259681    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259878 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259716    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket\") pod \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\" (UID: \"1c8e2c29-aff7-4bda-8a7c-b882ef82c99a\") "
Jul 23 18:54:14.259878 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259793    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:14.260127 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.259964    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:14.260127 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.260063    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.260229 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.260186    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:54:14.260355 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.260285    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:14.260828 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.260801    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:14.261761 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.261736    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:54:14.261869 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.261732    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:14.261869 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.261812    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:54:14.261869 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.261844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj" (OuterVolumeSpecName: "kube-api-access-mhrkj") pod "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" (UID: "1c8e2c29-aff7-4bda-8a7c-b882ef82c99a"). InnerVolumeSpecName "kube-api-access-mhrkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:54:14.361027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.360990    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhrkj\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-kube-api-access-mhrkj\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361022    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361031    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361027 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361040    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361048    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361056    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361064    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.361307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.361072    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:14.532257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.532226    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:54:14.535534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:14.535503    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e16158-openshift-default-dbdf54577-b57pz"]
Jul 23 18:54:15.575181 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:15.575150    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" path="/var/lib/kubelet/pods/1c8e2c29-aff7-4bda-8a7c-b882ef82c99a/volumes"
Jul 23 18:54:30.949232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:30.949200    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:54:30.949708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:30.949400    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" containerID="cri-o://098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc" gracePeriod=30
Jul 23 18:54:31.073789 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.073740    2562 patch_prober.go:28] interesting pod/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:54:31.074011 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.073828    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:54:31.823786 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.823750    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:54:31.824313 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824296    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.824372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824317    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.824372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824336    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.824372 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824344    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.824471 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824422    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.824471 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.824438    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c8e2c29-aff7-4bda-8a7c-b882ef82c99a" containerName="istio-proxy"
Jul 23 18:54:31.828991 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.828968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.831956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.831936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-04f83f-openshift-default-dockercfg-ktqfm\""
Jul 23 18:54:31.844033 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.844008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:54:31.923507 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:31.923877 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:31.923803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqfl\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.024639 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.024639 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqfl\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025174 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.024824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.025228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.025267    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.025366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025550 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.025391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.025682 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.025550    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.027323 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.027297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.027424 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.027383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.033385 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.033360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.033499 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.033424    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqfl\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl\") pod \"e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") " pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.139646 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.139541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:32.281388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.281353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:54:32.284751 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:54:32.284723    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c18786_9411_40aa_96ce_72f2ef5baaf3.slice/crio-75129ddf5c19ebd0e93953402c618581f10bb26c3ec70d5f5d06644bfa46b4fd WatchSource:0}: Error finding container 75129ddf5c19ebd0e93953402c618581f10bb26c3ec70d5f5d06644bfa46b4fd: Status 404 returned error can't find the container with id 75129ddf5c19ebd0e93953402c618581f10bb26c3ec70d5f5d06644bfa46b4fd
Jul 23 18:54:32.286823 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.286790    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:32.286932 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.286852    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:32.286932 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.286885    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:32.296929 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:32.296903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerStarted","Data":"75129ddf5c19ebd0e93953402c618581f10bb26c3ec70d5f5d06644bfa46b4fd"}
Jul 23 18:54:33.302670 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:33.302630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerStarted","Data":"cf1432718c6accf2b6fc99c9fe22f0ece0044970364545a8156f1b6e1aa795d0"}
Jul 23 18:54:33.324956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:33.324893    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podStartSLOduration=2.324877867 podStartE2EDuration="2.324877867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:54:33.324319131 +0000 UTC m=+2312.417964583" watchObservedRunningTime="2026-07-23 18:54:33.324877867 +0000 UTC m=+2312.418523284"
Jul 23 18:54:34.140306 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:34.140268    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:34.145305 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:34.145281    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:34.307702 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:34.307670    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:34.308576 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:34.308556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:36.208435 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.208375    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:54:36.271271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271237    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271271 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44xc6\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271460    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271501    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271589 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271572    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo\") pod \"eb01f02b-e02a-4838-9388-bd138e8220ba\" (UID: \"eb01f02b-e02a-4838-9388-bd138e8220ba\") "
Jul 23 18:54:36.271988 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:54:36.271988 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.271925    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:36.272103 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.272025    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb01f02b-e02a-4838-9388-bd138e8220ba-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.272103 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.272044    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.272215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.272110    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:36.272215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.272151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:36.272215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.272133    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:36.273832 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.273808    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:54:36.273956 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.273941    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:54:36.274068 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.274049    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:54:36.274165 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.274145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6" (OuterVolumeSpecName: "kube-api-access-44xc6") pod "eb01f02b-e02a-4838-9388-bd138e8220ba" (UID: "eb01f02b-e02a-4838-9388-bd138e8220ba"). InnerVolumeSpecName "kube-api-access-44xc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:54:36.319133 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.319095    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerID="098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc" exitCode=0
Jul 23 18:54:36.319327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.319145    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"
Jul 23 18:54:36.319327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.319183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerDied","Data":"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"}
Jul 23 18:54:36.319327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.319242    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2" event={"ID":"eb01f02b-e02a-4838-9388-bd138e8220ba","Type":"ContainerDied","Data":"033adf04932b4302220039c8cecd7f67f4fbfac346f1b1367284beef349bb0eb"}
Jul 23 18:54:36.319327 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.319265    2562 scope.go:117] "RemoveContainer" containerID="098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"
Jul 23 18:54:36.333592 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.333567    2562 scope.go:117] "RemoveContainer" containerID="65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"
Jul 23 18:54:36.343604 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.343581    2562 scope.go:117] "RemoveContainer" containerID="098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"
Jul 23 18:54:36.343912 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:54:36.343891    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc\": container with ID starting with 098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc not found: ID does not exist" containerID="098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"
Jul 23 18:54:36.343975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.343922    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc"} err="failed to get container status \"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc\": rpc error: code = NotFound desc = could not find container \"098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc\": container with ID starting with 098a1d42c41be2a5091ef7f25ce6180cb48ca1062233dd7f56229b5971427ebc not found: ID does not exist"
Jul 23 18:54:36.343975 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.343947    2562 scope.go:117] "RemoveContainer" containerID="65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"
Jul 23 18:54:36.344194 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:54:36.344180    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362\": container with ID starting with 65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362 not found: ID does not exist" containerID="65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"
Jul 23 18:54:36.344239 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.344198    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362"} err="failed to get container status \"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362\": rpc error: code = NotFound desc = could not find container \"65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362\": container with ID starting with 65cdc312aeaa98f5baf4720d4d19912a0a54747a8489f7f767a442f495803362 not found: ID does not exist"
Jul 23 18:54:36.348896 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.348870    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:54:36.356055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.356029    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-aa7092-openshift-default-76b7469987-4tqc2"]
Jul 23 18:54:36.372982 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.372951    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.372982 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.372975    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.372982 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.372984    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44xc6\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-kube-api-access-44xc6\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.373226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.372993    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.373226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.373003    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.373226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.373010    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:36.373226 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:36.373020    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb01f02b-e02a-4838-9388-bd138e8220ba-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:54:37.574820 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:37.574791    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" path="/var/lib/kubelet/pods/eb01f02b-e02a-4838-9388-bd138e8220ba/volumes"
Jul 23 18:54:40.559419 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.559381    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:54:40.559996 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.559976    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.560042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.560002    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.560042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.560016    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.560042 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.560025    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.560154 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.560142    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.560193 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.560161    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb01f02b-e02a-4838-9388-bd138e8220ba" containerName="istio-proxy"
Jul 23 18:54:40.563693 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.563669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.566721 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.566686    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-65b807-openshift-default-dockercfg-jnwlj\""
Jul 23 18:54:40.575891 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.575857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:54:40.611844 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.611807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612138 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612234 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612294 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612356 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612356 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612464 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzjxd\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612464 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.612464 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.612435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713308 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713534 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzjxd\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713824 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713824 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713824 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.713824 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.713763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.714285 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.714185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.714285 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.714198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.714422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.714365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.714745 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.714704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.717408 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.717385    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.718585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.718539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.723182 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.723138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.723296 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.723225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzjxd\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd\") pod \"e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") " pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:40.876331 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:40.876227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:41.040945 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.040917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:54:41.043422 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:54:41.043396    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75ecc0d_d258_4e33_9f25_b7912a382eb5.slice/crio-96e83242d097c84ea6e7c760424038c5c52387b7565e3e21a99fcbd5b9358677 WatchSource:0}: Error finding container 96e83242d097c84ea6e7c760424038c5c52387b7565e3e21a99fcbd5b9358677: Status 404 returned error can't find the container with id 96e83242d097c84ea6e7c760424038c5c52387b7565e3e21a99fcbd5b9358677
Jul 23 18:54:41.045585 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.045547    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:41.045700 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.045635    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:41.045700 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.045679    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:41.345113 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.345072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerStarted","Data":"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"}
Jul 23 18:54:41.345303 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.345138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerStarted","Data":"96e83242d097c84ea6e7c760424038c5c52387b7565e3e21a99fcbd5b9358677"}
Jul 23 18:54:41.367931 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.367871    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podStartSLOduration=1.367850071 podStartE2EDuration="1.367850071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:54:41.364639814 +0000 UTC m=+2320.458285268" watchObservedRunningTime="2026-07-23 18:54:41.367850071 +0000 UTC m=+2320.461495491"
Jul 23 18:54:41.877111 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:41.877073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:42.882388 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:42.882357    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:43.355202 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:43.355162    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:43.356361 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:43.356327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:54:50.240857 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.240765    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:58930->10.132.0.57:15021: read: connection reset by peer" start-of-body=
Jul 23 18:54:50.240857 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.240831    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:58930->10.132.0.57:15021: read: connection reset by peer"
Jul 23 18:54:50.392163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.392128    2562 generic.go:356] "Generic (PLEG): container finished" podID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerID="cf1432718c6accf2b6fc99c9fe22f0ece0044970364545a8156f1b6e1aa795d0" exitCode=0
Jul 23 18:54:50.392377 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.392206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerDied","Data":"cf1432718c6accf2b6fc99c9fe22f0ece0044970364545a8156f1b6e1aa795d0"}
Jul 23 18:54:50.392715 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.392698    2562 scope.go:117] "RemoveContainer" containerID="cf1432718c6accf2b6fc99c9fe22f0ece0044970364545a8156f1b6e1aa795d0"
Jul 23 18:54:50.393801 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.393771    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:50.393886 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.393843    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:50.393886 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:50.393875    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:54:51.399459 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:51.399423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerStarted","Data":"ea8502e4307181cf3c984dddd6d057078f1223b653fab984f13f6569eb3b5b82"}
Jul 23 18:54:52.140952 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:52.140909    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:52.141179 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:52.140966    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 18:54:52.141179 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:52.141044    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 18:54:53.140433 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:53.140385    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 18:54:53.140973 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:53.140521    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 18:54:54.140756 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:54.140641    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 18:54:54.141232 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:54.140747    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 18:54:55.140512 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:55.140431    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 23 18:54:55.140743 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:55.140523    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 23 18:54:56.150760 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:56.150725    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:56.151422 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:56.151351    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:56.152267 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:56.152249    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:54:59.397666 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:59.397622    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 18:54:59.398246 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:54:59.397712    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 18:55:00.445712 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.445681    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerID="d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b" exitCode=0
Jul 23 18:55:00.446163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.445737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerDied","Data":"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"}
Jul 23 18:55:00.446163 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.446158    2562 scope.go:117] "RemoveContainer" containerID="d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"
Jul 23 18:55:00.447291 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.447252    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:00.447374 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.447357    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:00.447415 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:00.447396    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:01.455270 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:01.455230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerStarted","Data":"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"}
Jul 23 18:55:01.876465 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:01.876419    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:01.876708 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:01.876651    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:55:01.876790 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:01.876703    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 18:55:02.877739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:02.877699    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:55:02.878136 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:02.877758    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 18:55:03.876711 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:03.876672    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:55:03.876905 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:03.876728    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 18:55:04.877640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:04.877607    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 23 18:55:04.878024 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:04.877692    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 23 18:55:05.880442 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:05.880408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:05.880861 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:05.880801    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:05.881444 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:05.881425    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:22.355374 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:22.355338    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:55:22.356016 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:22.355572    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" containerID="cri-o://ea8502e4307181cf3c984dddd6d057078f1223b653fab984f13f6569eb3b5b82" gracePeriod=30
Jul 23 18:55:26.153622 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:26.153586    2562 patch_prober.go:28] interesting pod/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:55:26.154032 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:26.153660    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:55:27.590814 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.590781    2562 generic.go:356] "Generic (PLEG): container finished" podID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerID="ea8502e4307181cf3c984dddd6d057078f1223b653fab984f13f6569eb3b5b82" exitCode=0
Jul 23 18:55:27.591233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.590847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerDied","Data":"ea8502e4307181cf3c984dddd6d057078f1223b653fab984f13f6569eb3b5b82"}
Jul 23 18:55:27.591233 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.590924    2562 scope.go:117] "RemoveContainer" containerID="cf1432718c6accf2b6fc99c9fe22f0ece0044970364545a8156f1b6e1aa795d0"
Jul 23 18:55:27.614855 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.614795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:55:27.689739 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.689919 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.689919 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.689919 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689821    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.689919 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.689919 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmqfl\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.690196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.689949    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:27.690196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690002    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.690196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690064    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.690196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690092    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:27.690196 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690113    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert\") pod \"27c18786-9411-40aa-96ce-72f2ef5baaf3\" (UID: \"27c18786-9411-40aa-96ce-72f2ef5baaf3\") "
Jul 23 18:55:27.690456 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690250    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:27.690556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690468    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.690556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690523    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.690556 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690538    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.690798 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690773    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data" (OuterVolumeSpecName: "istio-data") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:27.690904 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.690836    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:55:27.692151 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.692127    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token" (OuterVolumeSpecName: "istio-token") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:55:27.692431 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.692408    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:27.692575 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.692547    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:55:27.692641 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.692554    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl" (OuterVolumeSpecName: "kube-api-access-hmqfl") pod "27c18786-9411-40aa-96ce-72f2ef5baaf3" (UID: "27c18786-9411-40aa-96ce-72f2ef5baaf3"). InnerVolumeSpecName "kube-api-access-hmqfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:55:27.791030 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.790993    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.791030 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.791023    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.791030 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.791034    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmqfl\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-kube-api-access-hmqfl\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.791282 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.791047    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.791282 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.791055    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c18786-9411-40aa-96ce-72f2ef5baaf3-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:27.791282 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:27.791063    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c18786-9411-40aa-96ce-72f2ef5baaf3-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:28.597290 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:28.597256    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"
Jul 23 18:55:28.597744 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:28.597302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk" event={"ID":"27c18786-9411-40aa-96ce-72f2ef5baaf3","Type":"ContainerDied","Data":"75129ddf5c19ebd0e93953402c618581f10bb26c3ec70d5f5d06644bfa46b4fd"}
Jul 23 18:55:28.597744 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:28.597355    2562 scope.go:117] "RemoveContainer" containerID="ea8502e4307181cf3c984dddd6d057078f1223b653fab984f13f6569eb3b5b82"
Jul 23 18:55:28.619798 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:28.619769    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:55:28.624558 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:28.624533    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-04f83f-openshift-default-cc98c7489-tfppk"]
Jul 23 18:55:29.574983 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:29.574952    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" path="/var/lib/kubelet/pods/27c18786-9411-40aa-96ce-72f2ef5baaf3/volumes"
Jul 23 18:55:49.461794 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:49.461761    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:55:49.462215 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:49.462000    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" containerID="cri-o://99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f" gracePeriod=30
Jul 23 18:55:50.342640 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.342602    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 18:55:50.343141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.343126    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:50.343199 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.343144    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:50.343261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.343250    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:50.343317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.343273    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:50.346641 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.346619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.350351 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.350332    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3f12e9-openshift-default-dockercfg-r4mkb\""
Jul 23 18:55:50.358838 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.358815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 18:55:50.398069 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398069 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398307 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.398616 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.398313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts9d2\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499259 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts9d2\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.499771 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.500189 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.500189 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.499984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.500189 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.500110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.500290 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.500197    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.500335 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.500292    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.502035 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.502003    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.502209 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.502192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.507870 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.507845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.508129 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.508109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts9d2\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2\") pod \"e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") " pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.658864 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.658781    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:50.816968 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.816940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 18:55:50.819429 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:55:50.819400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ed3702_5277_4be2_b9c3_386941ebf9c2.slice/crio-d7063bc3c31b7da1cb5b0f326ea9b8d7df39709a7fa1a69ec18a150223e53532 WatchSource:0}: Error finding container d7063bc3c31b7da1cb5b0f326ea9b8d7df39709a7fa1a69ec18a150223e53532: Status 404 returned error can't find the container with id d7063bc3c31b7da1cb5b0f326ea9b8d7df39709a7fa1a69ec18a150223e53532
Jul 23 18:55:50.821594 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.821561    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:50.821693 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.821625    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:50.821693 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.821654    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:50.883156 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.883128    2562 patch_prober.go:28] interesting pod/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:55:50.883261 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:50.883186    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:55:51.713523 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:51.713463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerStarted","Data":"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"}
Jul 23 18:55:51.714034 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:51.713546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerStarted","Data":"d7063bc3c31b7da1cb5b0f326ea9b8d7df39709a7fa1a69ec18a150223e53532"}
Jul 23 18:55:51.738155 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:51.738105    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podStartSLOduration=1.738088606 podStartE2EDuration="1.738088606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:55:51.736647163 +0000 UTC m=+2390.830292592" watchObservedRunningTime="2026-07-23 18:55:51.738088606 +0000 UTC m=+2390.831734023"
Jul 23 18:55:52.659356 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:52.659320    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:52.664134 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:52.664110    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:52.718251 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:52.718222    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:52.719317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:52.719298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:55:54.718745 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.718717    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:54.729829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.729746    2562 generic.go:356] "Generic (PLEG): container finished" podID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerID="99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f" exitCode=0
Jul 23 18:55:54.729829 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.729793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"
Jul 23 18:55:54.730006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.729826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerDied","Data":"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"}
Jul 23 18:55:54.730006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.729880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x" event={"ID":"c75ecc0d-d258-4e33-9f25-b7912a382eb5","Type":"ContainerDied","Data":"96e83242d097c84ea6e7c760424038c5c52387b7565e3e21a99fcbd5b9358677"}
Jul 23 18:55:54.730006 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.729911    2562 scope.go:117] "RemoveContainer" containerID="99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"
Jul 23 18:55:54.736304 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736304 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736308    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736337    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736366    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzjxd\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736545 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736548    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736758 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket\") pod \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\" (UID: \"c75ecc0d-d258-4e33-9f25-b7912a382eb5\") "
Jul 23 18:55:54.736910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:54.736910 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736850    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:55:54.737020 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736965    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.737020 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.736983    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.737137 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.737056    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:54.737198 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.737174    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:54.737843 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.737818    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:54.739816 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.739786    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:55:54.739941 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.739826    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd" (OuterVolumeSpecName: "kube-api-access-vzjxd") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "kube-api-access-vzjxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:55:54.740120 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.740093    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:55:54.740616 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.740592    2562 scope.go:117] "RemoveContainer" containerID="d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"
Jul 23 18:55:54.741856 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.741835    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c75ecc0d-d258-4e33-9f25-b7912a382eb5" (UID: "c75ecc0d-d258-4e33-9f25-b7912a382eb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:55:54.757908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.757884    2562 scope.go:117] "RemoveContainer" containerID="99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"
Jul 23 18:55:54.758187 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:55:54.758166    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f\": container with ID starting with 99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f not found: ID does not exist" containerID="99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"
Jul 23 18:55:54.758257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.758197    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f"} err="failed to get container status \"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f\": rpc error: code = NotFound desc = could not find container \"99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f\": container with ID starting with 99924e4a4f76bd96be2dc51991412ed0d7b0f1a98e4e7b8705f9ccf4595d0d5f not found: ID does not exist"
Jul 23 18:55:54.758257 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.758216    2562 scope.go:117] "RemoveContainer" containerID="d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"
Jul 23 18:55:54.758491 ip-10-0-137-146 kubenswrapper[2562]: E0723 18:55:54.758466    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b\": container with ID starting with d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b not found: ID does not exist" containerID="d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"
Jul 23 18:55:54.758547 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.758498    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b"} err="failed to get container status \"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b\": rpc error: code = NotFound desc = could not find container \"d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b\": container with ID starting with d3640e63089c52dca2042ad2f98b6f704060826b9e135cf39dcd5ced5e00d84b not found: ID does not exist"
Jul 23 18:55:54.838055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838020    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838055 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838056    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838071    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838087    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838101    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838115    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzjxd\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-kube-api-access-vzjxd\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:54.838316 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:54.838128    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c75ecc0d-d258-4e33-9f25-b7912a382eb5-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 18:55:55.052810 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:55.052777    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:55:55.056845 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:55.056817    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-65b807-openshift-default-68bcc8c945-g5f9x"]
Jul 23 18:55:55.574773 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:55.574740    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" path="/var/lib/kubelet/pods/c75ecc0d-d258-4e33-9f25-b7912a382eb5/volumes"
Jul 23 18:55:58.893505 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893459    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 18:55:58.893906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893830    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:58.893906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893840    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c18786-9411-40aa-96ce-72f2ef5baaf3" containerName="istio-proxy"
Jul 23 18:55:58.893906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893853    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 18:55:58.893906 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893859    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 18:55:58.894050 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893914    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 18:55:58.894050 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.893923    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 18:55:58.898246 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.898229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.904818 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.904518    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-60de5a-openshift-default-dockercfg-75dnl\""
Jul 23 18:55:58.935188 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.935150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 18:55:58.977849 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.977810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978060 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.977873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978060 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.977988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978060 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978228 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm6lm\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:58.978382 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:58.978290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079419 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079628 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.079804 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm6lm\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.080128 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.079930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.080128 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.080111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.080285 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.080264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.080368 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.080333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.080368 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.080347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.082312 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.082289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.082499 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.082461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.093066 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.093039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.096692 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.096669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm6lm\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm\") pod \"e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") " pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.208522 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.208409    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:55:59.366851 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.366812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 18:55:59.371515 ip-10-0-137-146 kubenswrapper[2562]: W0723 18:55:59.371456    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd53a44_ec0d_4a95_bf90_87cf26b4f580.slice/crio-a022e306d206b8907f00f0359a883922826feb2e2e711ed726a8b8bfc3b5f7cd WatchSource:0}: Error finding container a022e306d206b8907f00f0359a883922826feb2e2e711ed726a8b8bfc3b5f7cd: Status 404 returned error can't find the container with id a022e306d206b8907f00f0359a883922826feb2e2e711ed726a8b8bfc3b5f7cd
Jul 23 18:55:59.373696 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.373667    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:59.373763 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.373735    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:59.373800 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.373768    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:55:59.759766 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.759724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerStarted","Data":"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"}
Jul 23 18:55:59.759997 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.759785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerStarted","Data":"a022e306d206b8907f00f0359a883922826feb2e2e711ed726a8b8bfc3b5f7cd"}
Jul 23 18:55:59.795452 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:55:59.795398    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podStartSLOduration=1.795381848 podStartE2EDuration="1.795381848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:55:59.793212616 +0000 UTC m=+2398.886858056" watchObservedRunningTime="2026-07-23 18:55:59.795381848 +0000 UTC m=+2398.889027264"
Jul 23 18:56:00.208721 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:00.208686    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:00.213789 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:00.213764    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:00.764317 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:00.764291    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:00.765379 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:00.765359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:06.804410 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.804320    2562 generic.go:356] "Generic (PLEG): container finished" podID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerID="5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837" exitCode=0
Jul 23 18:56:06.804410 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.804391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerDied","Data":"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"}
Jul 23 18:56:06.804885 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.804826    2562 scope.go:117] "RemoveContainer" containerID="5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"
Jul 23 18:56:06.805908 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.805875    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:06.806023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.805947    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:06.806023 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:06.805979    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:07.719032 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:07.718998    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:56:07.810465 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:07.810431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerStarted","Data":"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"}
Jul 23 18:56:08.660551 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:08.660519    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:56:08.660941 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:08.660914    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 18:56:08.661141 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:08.661115    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 18:56:09.659927 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:09.659891    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 18:56:09.660532 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:09.660498    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 18:56:10.659450 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:10.659403    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 18:56:10.659689 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:10.659492    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 18:56:11.659987 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:11.659944    2562 patch_prober.go:28] interesting pod/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 18:56:11.660466 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:11.660012    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 18:56:12.664265 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:12.664232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:56:12.664722 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:12.664606    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:56:12.665443 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:12.665419    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 18:56:13.843837 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.843797    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerID="32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457" exitCode=0
Jul 23 18:56:13.844328 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.843871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerDied","Data":"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"}
Jul 23 18:56:13.844387 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.844338    2562 scope.go:117] "RemoveContainer" containerID="32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"
Jul 23 18:56:13.845432 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.845407    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:13.845522 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.845502    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:13.845568 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:13.845542    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:56:14.853652 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:14.853616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerStarted","Data":"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"}
Jul 23 18:56:15.208732 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:15.208628    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:15.209705 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:15.209678    2562 patch_prober.go:28] interesting pod/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:56:15.209784 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:15.209732    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 18:56:15.764888 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:15.764850    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:16.209093 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:16.209056    2562 patch_prober.go:28] interesting pod/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:56:16.209552 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:16.209115    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 18:56:17.209273 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:17.209236    2562 patch_prober.go:28] interesting pod/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:56:17.209724 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:17.209297    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 18:56:18.208844 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:18.208805    2562 patch_prober.go:28] interesting pod/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 23 18:56:18.209035 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:18.208858    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 23 18:56:19.213431 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:19.213395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 18:56:19.214355 ip-10-0-137-146 kubenswrapper[2562]: I0723 18:56:19.214334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 19:02:19.598272 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:19.598240    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 19:02:19.598759 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:19.598435    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy" containerID="cri-o://5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06" gracePeriod=30
Jul 23 19:02:24.847087 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.847060    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 19:02:24.970372 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970372 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970407    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts9d2\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970550    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970556    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970594    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.970678 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs\") pod \"62ed3702-5277-4be2-b9c3-386941ebf9c2\" (UID: \"62ed3702-5277-4be2-b9c3-386941ebf9c2\") "
Jul 23 19:02:24.971093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970778    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:24.971093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.970993    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:24.971093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.971008    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:24.971093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.971013    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:24.971093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.971022    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:02:24.971591 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.971557    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:24.972753 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.972724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:24.972753 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.972742    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2" (OuterVolumeSpecName: "kube-api-access-ts9d2") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "kube-api-access-ts9d2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:02:24.972908 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.972778    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:02:24.972949 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:24.972923    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62ed3702-5277-4be2-b9c3-386941ebf9c2" (UID: "62ed3702-5277-4be2-b9c3-386941ebf9c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:02:25.071538 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071508    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071538 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071534    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts9d2\" (UniqueName: \"kubernetes.io/projected/62ed3702-5277-4be2-b9c3-386941ebf9c2-kube-api-access-ts9d2\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071538 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071544    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62ed3702-5277-4be2-b9c3-386941ebf9c2-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071763 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071553    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071763 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071561    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071763 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071569    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62ed3702-5277-4be2-b9c3-386941ebf9c2-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.071763 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.071577    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62ed3702-5277-4be2-b9c3-386941ebf9c2-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:25.610706 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.610672    2562 generic.go:356] "Generic (PLEG): container finished" podID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerID="5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06" exitCode=0
Jul 23 19:02:25.610852 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.610725    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"
Jul 23 19:02:25.610852 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.610749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerDied","Data":"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"}
Jul 23 19:02:25.610852 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.610806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf" event={"ID":"62ed3702-5277-4be2-b9c3-386941ebf9c2","Type":"ContainerDied","Data":"d7063bc3c31b7da1cb5b0f326ea9b8d7df39709a7fa1a69ec18a150223e53532"}
Jul 23 19:02:25.610852 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.610828    2562 scope.go:117] "RemoveContainer" containerID="5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"
Jul 23 19:02:25.620082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.620064    2562 scope.go:117] "RemoveContainer" containerID="5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"
Jul 23 19:02:25.628279 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.628261    2562 scope.go:117] "RemoveContainer" containerID="5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"
Jul 23 19:02:25.628579 ip-10-0-137-146 kubenswrapper[2562]: E0723 19:02:25.628554    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06\": container with ID starting with 5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06 not found: ID does not exist" containerID="5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"
Jul 23 19:02:25.628646 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.628587    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06"} err="failed to get container status \"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06\": rpc error: code = NotFound desc = could not find container \"5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06\": container with ID starting with 5c894183e974506a0eb06d269b7ad1bf5fd6cb1ba000f277fcfa009d3e711b06 not found: ID does not exist"
Jul 23 19:02:25.628646 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.628601    2562 scope.go:117] "RemoveContainer" containerID="5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"
Jul 23 19:02:25.628854 ip-10-0-137-146 kubenswrapper[2562]: E0723 19:02:25.628835    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837\": container with ID starting with 5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837 not found: ID does not exist" containerID="5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"
Jul 23 19:02:25.628901 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.628861    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837"} err="failed to get container status \"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837\": rpc error: code = NotFound desc = could not find container \"5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837\": container with ID starting with 5cf96c3f905a4df39438ef8abe3f024603ebdda508bbf9f5894e35ab315c3837 not found: ID does not exist"
Jul 23 19:02:25.633999 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.633976    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 19:02:25.639130 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:25.639106    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3f12e9-openshift-default-74769b444c-5bplf"]
Jul 23 19:02:27.574683 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:27.574651    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" path="/var/lib/kubelet/pods/62ed3702-5277-4be2-b9c3-386941ebf9c2/volumes"
Jul 23 19:02:41.978807 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:41.978772    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 19:02:41.979434 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:41.978979    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy" containerID="cri-o://79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db" gracePeriod=30
Jul 23 19:02:47.235558 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.235530    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 19:02:47.270278 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270256    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270457 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270297    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270457 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270457 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270457 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270457 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270759 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270492    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270759 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270530    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270759 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm6lm\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm\") pod \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\" (UID: \"0fd53a44-ec0d-4a95-bf90-87cf26b4f580\") "
Jul 23 19:02:47.270925 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270783    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:47.270925 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270903    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 19:02:47.271035 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.270949    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:47.271188 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.271161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:47.271670 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.271645    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:47.272688 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.272665    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 19:02:47.273056 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.273029    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:02:47.273153 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.273037    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm" (OuterVolumeSpecName: "kube-api-access-qm6lm") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "kube-api-access-qm6lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 19:02:47.273229 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.273194    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fd53a44-ec0d-4a95-bf90-87cf26b4f580" (UID: "0fd53a44-ec0d-4a95-bf90-87cf26b4f580"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 19:02:47.371846 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371809    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-certs\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.371846 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371838    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-data\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.371846 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371847    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-podinfo\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.371846 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371855    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm6lm\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-kube-api-access-qm6lm\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.372122 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371864    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-token\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.372122 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371872    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istio-envoy\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.372122 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371879    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-istiod-ca-cert\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.372122 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371887    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-workload-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.372122 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.371895    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fd53a44-ec0d-4a95-bf90-87cf26b4f580-credential-socket\") on node \"ip-10-0-137-146.ec2.internal\" DevicePath \"\""
Jul 23 19:02:47.716793 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.716758    2562 generic.go:356] "Generic (PLEG): container finished" podID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerID="79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db" exitCode=0
Jul 23 19:02:47.716970 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.716805    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"
Jul 23 19:02:47.716970 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.716836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerDied","Data":"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"}
Jul 23 19:02:47.716970 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.716891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd" event={"ID":"0fd53a44-ec0d-4a95-bf90-87cf26b4f580","Type":"ContainerDied","Data":"a022e306d206b8907f00f0359a883922826feb2e2e711ed726a8b8bfc3b5f7cd"}
Jul 23 19:02:47.716970 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.716912    2562 scope.go:117] "RemoveContainer" containerID="79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"
Jul 23 19:02:47.725838 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.725823    2562 scope.go:117] "RemoveContainer" containerID="32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"
Jul 23 19:02:47.734111 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.734080    2562 scope.go:117] "RemoveContainer" containerID="79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"
Jul 23 19:02:47.734359 ip-10-0-137-146 kubenswrapper[2562]: E0723 19:02:47.734340    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db\": container with ID starting with 79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db not found: ID does not exist" containerID="79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"
Jul 23 19:02:47.734426 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.734369    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db"} err="failed to get container status \"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db\": rpc error: code = NotFound desc = could not find container \"79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db\": container with ID starting with 79c26abd52802f95a8024d4b414e3cdd9b35a786e46688fda35fbec85bb8d3db not found: ID does not exist"
Jul 23 19:02:47.734426 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.734393    2562 scope.go:117] "RemoveContainer" containerID="32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"
Jul 23 19:02:47.734644 ip-10-0-137-146 kubenswrapper[2562]: E0723 19:02:47.734627    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457\": container with ID starting with 32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457 not found: ID does not exist" containerID="32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"
Jul 23 19:02:47.734692 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.734648    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457"} err="failed to get container status \"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457\": rpc error: code = NotFound desc = could not find container \"32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457\": container with ID starting with 32aa527ad2cdc3bf550ae7eaa7da0a0b987744e0ce6e6d63f6f23f6442790457 not found: ID does not exist"
Jul 23 19:02:47.735619 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.735597    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 19:02:47.739625 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:47.739599    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-60de5a-openshift-default-74656fcff-qtvbd"]
Jul 23 19:02:48.075581 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:48.075556    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-klssh_55447e88-9a6f-45b9-a95c-71a434c8b171/manager/0.log"
Jul 23 19:02:48.306551 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:48.306522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58f696bbc7-7zzrt_280803f9-2be6-4833-8d2e-85a50be14b76/manager/0.log"
Jul 23 19:02:48.536021 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:48.535994    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pl7d2_4bd29ab8-15f4-4d12-b778-29856f153d3d/manager/0.log"
Jul 23 19:02:48.905628 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:48.905540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bdbd87db-kxt5w_dd564a2b-6609-4808-b14f-83b7f2025db0/copy-manifests/0.log"
Jul 23 19:02:48.913342 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:48.913295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bdbd87db-kxt5w_dd564a2b-6609-4808-b14f-83b7f2025db0/manager/0.log"
Jul 23 19:02:49.282009 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:49.281985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-987c8d7cd-89tq5_4679668f-1dc5-4d8f-a54d-90acc4d5b091/maas-api/0.log"
Jul 23 19:02:49.404113 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:49.404089    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747190-nl9xk_ce8307be-7856-4639-ae81-dd50a95af233/cleanup/0.log"
Jul 23 19:02:49.575348 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:49.575271    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" path="/var/lib/kubelet/pods/0fd53a44-ec0d-4a95-bf90-87cf26b4f580/volumes"
Jul 23 19:02:49.743719 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:49.743688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gqgfd_60384ba0-4f3e-4721-926e-30f97dd0d645/postgres/0.log"
Jul 23 19:02:51.474164 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:51.474134    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-skq5n_3f284554-6e7c-4a6d-ad09-355e03033c58/registry-server/0.log"
Jul 23 19:02:51.597586 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:51.597552    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sv4h2_0424f650-04f6-4588-a9d1-b6e8f7b07bfc/manager/0.log"
Jul 23 19:02:52.295015 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:52.294970    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fp6s2_e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61/discovery/0.log"
Jul 23 19:02:52.529859 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:52.529829    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b75b7b5f6-gth2l_452ffd09-056e-4c77-949e-05d01d585cc1/kube-auth-proxy/0.log"
Jul 23 19:02:52.650013 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:52.649924    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/1.log"
Jul 23 19:02:52.769325 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:52.769293    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wjnq_8879a411-eeff-482c-ace0-934eb4921977/payload-pre-processing/0.log"
Jul 23 19:02:53.362041 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:53.361992    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zs9p2_df7060b6-c106-47cd-ba01-76c2cf55d9a7/main/0.log"
Jul 23 19:02:53.716315 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:02:53.716236    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9vbs5_f9fec76a-f83a-453e-97b0-b5f53f4ef12a/main/0.log"
Jul 23 19:03:02.623735 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:02.623697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8t2fg_83f7da9e-35c2-4854-a811-ebcce303e908/global-pull-secret-syncer/0.log"
Jul 23 19:03:02.809628 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:02.809596    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8zkdd_c6cac72e-adc0-40a5-a935-b77cacbd790e/konnectivity-agent/0.log"
Jul 23 19:03:02.895966 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:02.895881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-146.ec2.internal_4579c837d06b9a85c3e22429bd334f55/haproxy/0.log"
Jul 23 19:03:08.032225 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:08.032190    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-skq5n_3f284554-6e7c-4a6d-ad09-355e03033c58/registry-server/0.log"
Jul 23 19:03:08.163828 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:08.163795    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sv4h2_0424f650-04f6-4588-a9d1-b6e8f7b07bfc/manager/0.log"
Jul 23 19:03:10.074341 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:10.074309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-cthmx_e7da54e1-ab75-41ad-9229-cee29e1bb9ac/cluster-monitoring-operator/0.log"
Jul 23 19:03:10.336135 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:10.336046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8pfp_c23d55cc-1565-4578-8d49-60755590a242/node-exporter/0.log"
Jul 23 19:03:10.355454 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:10.355426    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8pfp_c23d55cc-1565-4578-8d49-60755590a242/kube-rbac-proxy/0.log"
Jul 23 19:03:10.379960 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:10.379928    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t8pfp_c23d55cc-1565-4578-8d49-60755590a242/init-textfile/0.log"
Jul 23 19:03:12.490687 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.490654    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"]
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491027    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491038    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491048    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491055    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491062    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491069    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491080    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 19:03:12.491088 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491085    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75ecc0d-d258-4e33-9f25-b7912a382eb5" containerName="istio-proxy"
Jul 23 19:03:12.491391 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491150    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fd53a44-ec0d-4a95-bf90-87cf26b4f580" containerName="istio-proxy"
Jul 23 19:03:12.491391 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491158    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy"
Jul 23 19:03:12.491391 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.491164    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ed3702-5277-4be2-b9c3-386941ebf9c2" containerName="istio-proxy"
Jul 23 19:03:12.494093 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.494073    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.496967 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.496940    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-48l67\"/\"openshift-service-ca.crt\""
Jul 23 19:03:12.497117 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.496979    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-48l67\"/\"kube-root-ca.crt\""
Jul 23 19:03:12.498173 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.498151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-48l67\"/\"default-dockercfg-r5r2t\""
Jul 23 19:03:12.504802 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.504779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"]
Jul 23 19:03:12.605248 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.605214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzd74\" (UniqueName: \"kubernetes.io/projected/e8869166-4621-4c9e-9873-856da9d4322c-kube-api-access-nzd74\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.605433 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.605265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-lib-modules\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.605433 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.605323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-proc\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.605433 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.605399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-sys\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.605433 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.605416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-podres\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.706820 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-sys\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.706820 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-podres\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzd74\" (UniqueName: \"kubernetes.io/projected/e8869166-4621-4c9e-9873-856da9d4322c-kube-api-access-nzd74\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-lib-modules\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-proc\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706919    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-sys\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.706997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-proc\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.707043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-podres\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.707082 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.707048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8869166-4621-4c9e-9873-856da9d4322c-lib-modules\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.715559 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.715536    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzd74\" (UniqueName: \"kubernetes.io/projected/e8869166-4621-4c9e-9873-856da9d4322c-kube-api-access-nzd74\") pod \"perf-node-gather-daemonset-2kmw9\" (UID: \"e8869166-4621-4c9e-9873-856da9d4322c\") " pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.804756 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.804723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:12.940327 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:12.940272    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"]
Jul 23 19:03:12.943161 ip-10-0-137-146 kubenswrapper[2562]: W0723 19:03:12.943135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode8869166_4621_4c9e_9873_856da9d4322c.slice/crio-bf33ae28afd1894140db69b109411673889090b92e001d7d40b21460e5d8a7ca WatchSource:0}: Error finding container bf33ae28afd1894140db69b109411673889090b92e001d7d40b21460e5d8a7ca: Status 404 returned error can't find the container with id bf33ae28afd1894140db69b109411673889090b92e001d7d40b21460e5d8a7ca
Jul 23 19:03:13.841772 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:13.841737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9" event={"ID":"e8869166-4621-4c9e-9873-856da9d4322c","Type":"ContainerStarted","Data":"221f9429c8a237b52ee84022e2d721d77c935ba540be52444e330ba2b9350594"}
Jul 23 19:03:13.842176 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:13.841792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9" event={"ID":"e8869166-4621-4c9e-9873-856da9d4322c","Type":"ContainerStarted","Data":"bf33ae28afd1894140db69b109411673889090b92e001d7d40b21460e5d8a7ca"}
Jul 23 19:03:13.842176 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:13.841823    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:13.859110 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:13.859057    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9" podStartSLOduration=1.859041413 podStartE2EDuration="1.859041413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 19:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 19:03:13.857742725 +0000 UTC m=+2832.951388153" watchObservedRunningTime="2026-07-23 19:03:13.859041413 +0000 UTC m=+2832.952686829"
Jul 23 19:03:15.117496 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:15.117451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-674n8_1a7dffed-4275-46ee-b961-32563c743a61/dns/0.log"
Jul 23 19:03:15.154824 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:15.154794    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-674n8_1a7dffed-4275-46ee-b961-32563c743a61/kube-rbac-proxy/0.log"
Jul 23 19:03:15.344806 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:15.344778    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nmcxl_ade9c15f-dc6f-4b81-a470-5eec01f93f2f/dns-node-resolver/0.log"
Jul 23 19:03:15.996158 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:15.996122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gs7xj_97fb56ac-194c-4bc6-b38f-382f255e7961/node-ca/0.log"
Jul 23 19:03:17.055649 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:17.055613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fp6s2_e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61/discovery/0.log"
Jul 23 19:03:17.150973 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:17.150945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b75b7b5f6-gth2l_452ffd09-056e-4c77-949e-05d01d585cc1/kube-auth-proxy/0.log"
Jul 23 19:03:17.196318 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:17.196286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/0.log"
Jul 23 19:03:17.221878 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:17.221832    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/1.log"
Jul 23 19:03:17.271110 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:17.271084    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wjnq_8879a411-eeff-482c-ace0-934eb4921977/payload-pre-processing/0.log"
Jul 23 19:03:18.084145 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.084117    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nqz7p_3215bb10-4a3b-4061-a7c5-ba08a9c49098/serve-healthcheck-canary/0.log"
Jul 23 19:03:18.535119 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.535090    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rllx6_2a2d4021-244c-4afb-aa43-7cbeefd81d6d/insights-operator/0.log"
Jul 23 19:03:18.535309 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.535263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rllx6_2a2d4021-244c-4afb-aa43-7cbeefd81d6d/insights-operator/1.log"
Jul 23 19:03:18.687556 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.687525    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvtr4_2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3/kube-rbac-proxy/0.log"
Jul 23 19:03:18.708617 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.708591    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvtr4_2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3/exporter/0.log"
Jul 23 19:03:18.727720 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:18.727699    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vvtr4_2d2e2b2f-820e-439b-9692-2d2b4f4ebbd3/extractor/0.log"
Jul 23 19:03:19.856623 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:19.856596    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-48l67/perf-node-gather-daemonset-2kmw9"
Jul 23 19:03:20.849304 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:20.849275    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-klssh_55447e88-9a6f-45b9-a95c-71a434c8b171/manager/0.log"
Jul 23 19:03:21.156417 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:21.156295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58f696bbc7-7zzrt_280803f9-2be6-4833-8d2e-85a50be14b76/manager/0.log"
Jul 23 19:03:21.248389 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:21.248336    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pl7d2_4bd29ab8-15f4-4d12-b778-29856f153d3d/manager/0.log"
Jul 23 19:03:21.439782 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:21.439702    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bdbd87db-kxt5w_dd564a2b-6609-4808-b14f-83b7f2025db0/manager/0.log"
Jul 23 19:03:21.458763 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:21.458738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77bdbd87db-kxt5w_dd564a2b-6609-4808-b14f-83b7f2025db0/copy-manifests/0.log"
Jul 23 19:03:23.392840 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:23.392792    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fp6s2_e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61/discovery/0.log"
Jul 23 19:03:23.416133 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:23.416102    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b75b7b5f6-gth2l_452ffd09-056e-4c77-949e-05d01d585cc1/kube-auth-proxy/0.log"
Jul 23 19:03:23.432855 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:23.432828    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/0.log"
Jul 23 19:03:23.460044 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:23.459986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/1.log"
Jul 23 19:03:23.479762 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:23.479736    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wjnq_8879a411-eeff-482c-ace0-934eb4921977/payload-pre-processing/0.log"
Jul 23 19:03:24.819061 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:24.819028    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fp6s2_e2ea54bb-ebcb-4ddc-9042-c9b88aaeaf61/discovery/0.log"
Jul 23 19:03:24.849713 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:24.849687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b75b7b5f6-gth2l_452ffd09-056e-4c77-949e-05d01d585cc1/kube-auth-proxy/0.log"
Jul 23 19:03:24.869115 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:24.869088    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/0.log"
Jul 23 19:03:24.900888 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:24.900854    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-hgtjt_68bd3d8b-4b74-4ba0-ad51-66750a9dc68e/istio-proxy/1.log"
Jul 23 19:03:24.921327 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:24.921288    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-7wjnq_8879a411-eeff-482c-ace0-934eb4921977/payload-pre-processing/0.log"
Jul 23 19:03:28.150948 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:28.150917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-878rf_33c4116e-ea42-44a9-ad68-686bf84e4e99/kube-storage-version-migrator-operator/1.log"
Jul 23 19:03:28.152021 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:28.151997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-878rf_33c4116e-ea42-44a9-ad68-686bf84e4e99/kube-storage-version-migrator-operator/0.log"
Jul 23 19:03:29.155759 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.155732    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/kube-multus-additional-cni-plugins/0.log"
Jul 23 19:03:29.176339 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.176314    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/egress-router-binary-copy/0.log"
Jul 23 19:03:29.201166 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.201143    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/cni-plugins/0.log"
Jul 23 19:03:29.218596 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.218530    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/bond-cni-plugin/0.log"
Jul 23 19:03:29.239567 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.239537    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/routeoverride-cni/0.log"
Jul 23 19:03:29.262787 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.262764    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/whereabouts-cni-bincopy/0.log"
Jul 23 19:03:29.283709 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.283685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5x9hn_04e40790-7de4-400b-9d8b-3f302877e2b5/whereabouts-cni/0.log"
Jul 23 19:03:29.658764 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.658737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mcfm6_d9b68c6c-016a-49eb-a4be-9d650b000ddc/kube-multus/0.log"
Jul 23 19:03:29.759722 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.759698    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vwhbl_e27641c4-1d54-415b-a312-41c8364255ab/network-metrics-daemon/0.log"
Jul 23 19:03:29.778936 ip-10-0-137-146 kubenswrapper[2562]: I0723 19:03:29.778910    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vwhbl_e27641c4-1d54-415b-a312-41c8364255ab/kube-rbac-proxy/0.log"