Jul 10 22:55:53.911813 ip-10-0-139-179 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 22:55:54.295867 ip-10-0-139-179 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:55:54.295867 ip-10-0-139-179 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 22:55:54.295867 ip-10-0-139-179 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:55:54.295867 ip-10-0-139-179 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 22:55:54.295867 ip-10-0-139-179 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:55:54.297603 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.297517    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 22:55:54.302867 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302848    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.302867 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302867    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.302867 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302870    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302874    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302877    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302880    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302882    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302885    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302888    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302890    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302893    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302896    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302898    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302901    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302903    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302905    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302908    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302910    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302913    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302923    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302926    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302928    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.302968 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302931    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302933    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302936    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302938    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302941    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302943    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302945    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302948    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302950    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302952    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302955    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302957    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302960    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302962    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302966    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302969    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302974    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302979    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302983    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.303440 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302987    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302991    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302994    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302997    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.302999    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303002    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303004    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303007    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303010    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303012    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303015    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303018    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303020    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303023    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303025    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303028    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303030    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303034    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303036    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303039    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.303909 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303041    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303044    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303046    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303049    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303051    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303054    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303056    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303060    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303062    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303065    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303069    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303071    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303074    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303076    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303079    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303081    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303084    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303086    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303089    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303091    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.304426 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303093    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303098    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303102    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303105    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303108    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303110    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303113    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303116    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303118    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303121    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303124    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303127    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303129    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303131    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303134    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303137    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303140    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303142    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303874    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.304939 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303881    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303884    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303887    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303890    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303893    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303896    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303899    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303902    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303904    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303907    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303910    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303913    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303915    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303918    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303920    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303923    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303926    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303928    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303931    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303933    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.305387 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303936    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303938    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303941    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303943    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303946    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303949    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303952    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303954    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303957    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303960    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303963    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303965    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303968    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303971    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303974    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303976    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303979    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303982    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303984    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303987    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.305899 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303989    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303991    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303994    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303996    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.303999    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304001    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304003    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304008    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304011    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304015    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304017    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304020    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304023    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304025    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304028    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304030    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304033    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304036    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304039    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.306405 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304041    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304047    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304050    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304053    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304056    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304059    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304062    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304065    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304067    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304071    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304074    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304077    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304080    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304082    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304085    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304088    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304090    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304092    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304095    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.306893 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304097    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304099    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304102    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304104    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304106    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304109    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304111    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304114    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304116    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304118    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304121    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304124    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304126    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304129    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304131    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304134    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304137    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304140    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304142    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304145    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.307381 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304536    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304541    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304544    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304547    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304557    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304560    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304563    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304565    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304568    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304570    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304573    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304576    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304578    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304581    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304584    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304587    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304589    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304591    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304594    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304597    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.307888 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304599    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304602    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304605    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304607    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304610    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304612    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304617    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304620    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304624    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304626    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304629    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304632    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304634    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304637    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304639    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304641    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304643    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304651    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304654    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.308365 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304656    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304659    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304661    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304664    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304666    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304668    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304671    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304673    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304675    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304678    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304680    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304682    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304685    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304687    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304691    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304694    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304697    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304699    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304702    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304704    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.308883 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304707    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304709    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304711    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304714    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304718    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304721    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304724    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304726    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304729    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304731    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304734    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304738    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304740    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304743    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304745    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304747    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304750    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304752    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304757    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.309359 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304760    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304762    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304765    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304767    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304769    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304772    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304775    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304778    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304780    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304784    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304787    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304790    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304792    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304795    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304797    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304799    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304802    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304804    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304808    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.309836 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304811    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.304814    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304884    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304891    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304898    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304902    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304906    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304910    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304914    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304918    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304921    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304924    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304929    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304933    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304936    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304939    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304942    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304945    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304948    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304951    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304955    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304958    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304963    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304970    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 22:55:54.310290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304973    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304977    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304980    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304983    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304986    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304989    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304992    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304995    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.304998    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305001    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305005    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305007    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305010    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305013    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305016    2558 flags.go:64] FLAG: --enable-server="true"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305019    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305024    2558 flags.go:64] FLAG: --event-burst="100"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305027    2558 flags.go:64] FLAG: --event-qps="50"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305030    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305033    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305038    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305041    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305044    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305047    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305050    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 10 22:55:54.310890 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305053    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305055    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305059    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305062    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305065    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305069    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305072    2558 flags.go:64] FLAG: --feature-gates=""
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305075    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305078    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305081    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305085    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305087    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305090    2558 flags.go:64] FLAG: --help="false"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305093    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305096    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305099    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305102    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305105    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305108    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305111    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305114    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305117    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305119    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 22:55:54.311476 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305122    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305125    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305128    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305131    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305137    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305140    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305142    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305145    2558 flags.go:64] FLAG: --lock-file=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305148    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305150    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305153    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305159    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305161    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305164    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305168    2558 flags.go:64] FLAG: --logging-format="text"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305171    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305175    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305177    2558 flags.go:64] FLAG: --manifest-url=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305180    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305185    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305188    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305192    2558 flags.go:64] FLAG: --max-pods="110"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305195    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305198    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305201    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 22:55:54.312086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305204    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305207    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305210    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305213    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305219    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305222    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305225    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305228    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305232    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305238    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305241    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305245    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305248    2558 flags.go:64] FLAG: --port="10250"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305250    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305253    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0991e396d9d44cafb"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305256    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305259    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305262    2558 flags.go:64] FLAG: --register-node="true"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305265    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305268    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305270    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305273    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305278    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305281    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305284    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 22:55:54.312760 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305287    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305290    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305292    2558 flags.go:64] FLAG: --runonce="false"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305295    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305298    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305301    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305303    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305306    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305309    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305312    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305315    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305317    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305320    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305323    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305326    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305329    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305332    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305334    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305341    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305344    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305347    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305350    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305353    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305356    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305358    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 22:55:54.313353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305361    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305364    2558 flags.go:64] FLAG: --v="2"
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305367    2558 flags.go:64] FLAG: --version="false"
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305371    2558 flags.go:64] FLAG: --vmodule=""
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305376    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.305379    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305511    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305516    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305519    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305523    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305526    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305529    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305531    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305534    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305537    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305540    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305542    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305544    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305547    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305550    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305553    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.313979 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305555    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305557    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305560    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305563    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305568    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305571    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305573    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305576    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305578    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305581    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305584    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305586    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305589    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305591    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305594    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305598    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305601    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305604    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305607    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305609    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.314489 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305612    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305614    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305617    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305619    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305622    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305624    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305627    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305629    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305632    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305635    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305637    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305639    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305642    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305644    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305647    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305650    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305654    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305656    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305659    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305661    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.314992 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305664    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305667    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305669    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305673    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305676    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305679    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305682    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305686    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305689    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305692    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305695    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305697    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305700    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305702    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305705    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305707    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305710    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305714    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305717    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.315473 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305720    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305723    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305726    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305728    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305731    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305733    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305737    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305739    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305741    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305745    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305748    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305750    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305753    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305755    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305759    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305763    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305766    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305769    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305771    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.315938 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305774    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305781    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305783    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305786    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.305788    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.306478    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.313833    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.313851    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.314530    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.314542    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314615    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314620    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314624    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314627    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.316386 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314630    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314632    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314635    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314638    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314641    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314643    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314646    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314649    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314651    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314654    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314657    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314659    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314662    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314664    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314667    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314669    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314671    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314674    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314676    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314679    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.316782 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314682    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314685    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314687    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314690    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314692    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314700    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314704    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314708    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314711    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314715    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314717    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314720    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314723    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314725    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314729    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314733    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314736    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314739    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314742    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.317250 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314744    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314747    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314750    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314753    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314756    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314759    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314761    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314764    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314767    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314769    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314771    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314774    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314776    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314779    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314781    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314784    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314786    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314788    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314791    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314799    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.317733 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314801    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314804    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314807    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314809    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314812    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314815    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314817    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314819    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314822    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314824    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314826    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314829    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314832    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314834    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314836    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314839    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314841    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314844    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314846    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314850    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.318226 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314853    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314856    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314858    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314861    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314864    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314866    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314869    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314871    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314874    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314876    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314878    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314881    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314889    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314891    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314899    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.318732 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.314902    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.314907    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315065    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315070    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315074    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315077    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315080    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315082    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315085    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315087    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315090    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315092    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315095    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315097    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315100    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:55:54.319127 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315102    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315105    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315107    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315110    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315112    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315115    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315117    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315119    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315122    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315124    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315127    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315129    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315132    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315134    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315137    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315145    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315148    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315150    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315153    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315156    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:55:54.319521 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315158    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315161    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315163    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315166    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315168    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315170    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315173    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315175    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315177    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315179    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315182    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315184    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315186    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315189    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315191    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315194    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315196    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315199    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315201    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315204    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:55:54.320010 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315206    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315209    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315211    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315213    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315217    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315221    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315225    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315228    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315236    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315239    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315242    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315244    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315246    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315249    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315251    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315254    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315256    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315258    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315260    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:55:54.320493 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315263    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315265    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315268    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315270    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315272    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315274    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315277    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315279    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315282    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315284    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315287    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315289    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315292    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315294    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315298    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315301    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315304    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315307    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315309    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315312    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:55:54.321150 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315314    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315317    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315325    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315328    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315330    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315333    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:54.315335    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.315340    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.315467    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.317799    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.319036    2558 server.go:1019] "Starting client certificate rotation"
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.319134    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 22:55:54.321654 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.319172    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 22:55:54.322875 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.322851    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 22:55:54.324907 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.324883    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 22:55:54.334722 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.334699    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 10 22:55:54.337407 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.337389    2558 log.go:25] "Validated CRI v1 image API"
Jul 10 22:55:54.338184 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.338170    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 22:55:54.340640 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.340618    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 abdd16cd-2b5b-4272-88f3-b3846a275718:/dev/nvme0n1p4 ccdff248-c2ad-49cf-b7eb-2100564c1d67:/dev/nvme0n1p3]
Jul 10 22:55:54.340716 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.340638    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 22:55:54.345398 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.345288    2558 manager.go:216] Machine: {Timestamp:2026-07-10 22:55:54.344781269 +0000 UTC m=+0.320336262 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099015 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2860f492b8e66522b1557a23b0ea03 SystemUUID:ec2860f4-92b8-e665-22b1-557a23b0ea03 BootID:03882353-efd2-456e-bdc9-43d7b4bf6d69 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:93:71:69:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:93:71:69:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:74:d0:77:e2:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 22:55:54.345398 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.345394    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 22:55:54.345523 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.345470    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 22:55:54.348208 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.348178    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 22:55:54.348367 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.348217    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-179.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 22:55:54.349472 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.349462    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 22:55:54.349521 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.349475    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 22:55:54.349521 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.349484    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 22:55:54.350373 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.350363    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 22:55:54.351649 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.351638    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 22:55:54.352853 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.352836    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 22:55:54.355901 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.355890    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 22:55:54.356021 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356011    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 22:55:54.356054 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356043    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 22:55:54.356054 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356053    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 22:55:54.356107 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356070    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 22:55:54.356107 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356079    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 10 22:55:54.356107 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356088    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 22:55:54.356534 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356523    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 22:55:54.356625 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.356544    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 22:55:54.360065 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.360044    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 22:55:54.362175 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362160    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 22:55:54.362235 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362191    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 22:55:54.362823 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362810    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 22:55:54.362868 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362835    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 22:55:54.362868 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362844    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 22:55:54.362868 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362852    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 22:55:54.362868 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362865    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362874    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362885    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362893    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362902    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362910    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362922    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 22:55:54.362975 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.362930    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 22:55:54.363833 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.363820    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 22:55:54.363864 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.363835    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 22:55:54.365288 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.365256    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 22:55:54.365288 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.365260    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 22:55:54.365480 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.365453    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-179.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 22:55:54.367216 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.367202    2558 server.go:1268] "Started kubelet"
Jul 10 22:55:54.367308 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.367278    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 22:55:54.367355 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.367281    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 22:55:54.367355 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.367351    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 22:55:54.368132 ip-10-0-139-179 systemd[1]: Started Kubernetes Kubelet.
Jul 10 22:55:54.369825 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.369807    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 22:55:54.371432 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.371403    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 22:55:54.371864 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.371848    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qsdlf"
Jul 10 22:55:54.372958 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.372934    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 22:55:54.375842 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.375827    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 22:55:54.375842 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.375839    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 22:55:54.375966 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.375888    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.376438 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376418    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 22:55:54.376438 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376421    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 22:55:54.376574 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376449    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 22:55:54.376574 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376537    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 22:55:54.376574 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376544    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 22:55:54.376883 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376867    2558 factory.go:153] Registering CRI-O factory
Jul 10 22:55:54.376883 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376886    2558 factory.go:223] Registration of the crio container factory successfully
Jul 10 22:55:54.377026 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376939    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 22:55:54.377026 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376948    2558 factory.go:55] Registering systemd factory
Jul 10 22:55:54.377026 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376955    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 10 22:55:54.377026 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376976    2558 factory.go:103] Registering Raw factory
Jul 10 22:55:54.377026 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.376987    2558 manager.go:1196] Started watching for new ooms in manager
Jul 10 22:55:54.377427 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.377413    2558 manager.go:349] Starting recovery of all containers
Jul 10 22:55:54.379339 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.379309    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-179.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 22:55:54.379436 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.379383    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 22:55:54.380682 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.379563    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-179.ec2.internal.18c10faaf656dcf3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-179.ec2.internal,UID:ip-10-0-139-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-179.ec2.internal,},FirstTimestamp:2026-07-10 22:55:54.367171827 +0000 UTC m=+0.342726820,LastTimestamp:2026-07-10 22:55:54.367171827 +0000 UTC m=+0.342726820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-179.ec2.internal,}"
Jul 10 22:55:54.381609 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.381586    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qsdlf"
Jul 10 22:55:54.388103 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.388077    2558 manager.go:354] Recovery completed
Jul 10 22:55:54.393051 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.393038    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.394724 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.394708    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.394782 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.394741    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.394782 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.394754    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.395275 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.395256    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 22:55:54.395275 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.395270    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 22:55:54.395416 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.395286    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 22:55:54.395416 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.395301    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.395998 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.395982    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.396061 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.396015    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.396061 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.396030    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.397005 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.396938    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-179.ec2.internal.18c10faaf7fb4c46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-179.ec2.internal,UID:ip-10-0-139-179.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-179.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-179.ec2.internal,},FirstTimestamp:2026-07-10 22:55:54.394725446 +0000 UTC m=+0.370280442,LastTimestamp:2026-07-10 22:55:54.394725446 +0000 UTC m=+0.370280442,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-179.ec2.internal,}"
Jul 10 22:55:54.397309 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.397297    2558 policy_none.go:49] "None policy: Start"
Jul 10 22:55:54.397347 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.397317    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 22:55:54.397347 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.397331    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 22:55:54.399485 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.399474    2558 policy_none.go:47] "Start"
Jul 10 22:55:54.433102 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433085    2558 manager.go:337] "Starting Device Plugin manager"
Jul 10 22:55:54.433215 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.433127    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 22:55:54.433215 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433137    2558 server.go:87] "Starting device plugin registration server"
Jul 10 22:55:54.433429 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433415    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 22:55:54.433474 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433432    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 22:55:54.433535 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433518    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 22:55:54.433603 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433592    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 22:55:54.433603 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.433602    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 22:55:54.434859 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.434842    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 22:55:54.434944 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.434889    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.532292 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.532244    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 22:55:54.534533 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.533531    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.534533 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.533584    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 22:55:54.534533 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.533628    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 22:55:54.534533 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.533656    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 22:55:54.534533 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.533701    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 22:55:54.534837 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.534821    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.534895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.534860    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.534895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.534876    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.534985 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.534905    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.535901 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.535882    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:55:54.542441 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.542420    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.542557 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.542451    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-179.ec2.internal\": node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.551237 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.551194    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.634734 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.634698    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"]
Jul 10 22:55:54.634849 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.634789    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.635772 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.635756    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.635841 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.635787    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.635841 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.635805    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.638125 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638112    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.638240 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.638280 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638261    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.638942 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638925    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.639017 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638955    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.639017 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638964    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.639113 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.638931    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.639113 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.639047    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.639113 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.639063    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.641177 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.641157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.641274 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.641186    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:55:54.641938 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.641922    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:55:54.642009 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.641950    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:55:54.642009 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.641963    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:55:54.651304 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.651288    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.663338 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.663317    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-179.ec2.internal\" not found" node="ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.667887 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.667867    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-179.ec2.internal\" not found" node="ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.677382 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.677339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15eaeba84a5e31eea246ffc0b85b1644-config\") pod \"kube-apiserver-proxy-ip-10-0-139-179.ec2.internal\" (UID: \"15eaeba84a5e31eea246ffc0b85b1644\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.677382 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.677380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.677382 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.677396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.751743 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.751706    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.777996 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.777957    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.777996 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.778001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15eaeba84a5e31eea246ffc0b85b1644-config\") pod \"kube-apiserver-proxy-ip-10-0-139-179.ec2.internal\" (UID: \"15eaeba84a5e31eea246ffc0b85b1644\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.778141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.778018    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.778141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.778048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.778141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.778057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a7afc97894006e5c326a420b9300dbbc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal\" (UID: \"a7afc97894006e5c326a420b9300dbbc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.778141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.778064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15eaeba84a5e31eea246ffc0b85b1644-config\") pod \"kube-apiserver-proxy-ip-10-0-139-179.ec2.internal\" (UID: \"15eaeba84a5e31eea246ffc0b85b1644\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.852325 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.852254    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.952962 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:54.952921    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:54.965109 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.965083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:54.970943 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:54.970925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:55.053516 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.053466    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.154688 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.154641    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.255754 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.255706    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.318540 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.318491    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 22:55:55.319165 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.318689    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 22:55:55.357182 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.357150    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.386990 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.386956    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 22:50:54 +0000 UTC" deadline="2027-12-13 02:42:55.227115335 +0000 UTC"
Jul 10 22:55:55.386990 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.386985    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12483h46m59.840133456s"
Jul 10 22:55:55.457650 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.457620    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.461483 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.461459    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:55:55.531441 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:55.531406    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7afc97894006e5c326a420b9300dbbc.slice/crio-e80ed89073696c33fceb171bcb9abf9ae1da68dc3f4149f715563f18c0044275 WatchSource:0}: Error finding container e80ed89073696c33fceb171bcb9abf9ae1da68dc3f4149f715563f18c0044275: Status 404 returned error can't find the container with id e80ed89073696c33fceb171bcb9abf9ae1da68dc3f4149f715563f18c0044275
Jul 10 22:55:55.536875 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.536827    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal" event={"ID":"a7afc97894006e5c326a420b9300dbbc","Type":"ContainerStarted","Data":"e80ed89073696c33fceb171bcb9abf9ae1da68dc3f4149f715563f18c0044275"}
Jul 10 22:55:55.538734 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.538713    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 22:55:55.544776 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:55.544755    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15eaeba84a5e31eea246ffc0b85b1644.slice/crio-ac29c08d09e06c74c6c13e1a918ffa43ab29c6d278f2d7999ab9f62644e34c23 WatchSource:0}: Error finding container ac29c08d09e06c74c6c13e1a918ffa43ab29c6d278f2d7999ab9f62644e34c23: Status 404 returned error can't find the container with id ac29c08d09e06c74c6c13e1a918ffa43ab29c6d278f2d7999ab9f62644e34c23
Jul 10 22:55:55.558466 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.558444    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.663606 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.663527    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.766003 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:55.765958    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-179.ec2.internal\" not found"
Jul 10 22:55:55.814845 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.814816    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:55:55.876908 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.876879    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:55.888385 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.888362    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 22:55:55.890137 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.890122    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal"
Jul 10 22:55:55.893201 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.893186    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:55:55.895812 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:55.895790    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 22:55:56.256820 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.256781    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:55:56.357624 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.357584    2558 apiserver.go:52] "Watching apiserver"
Jul 10 22:55:56.363117 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.363093    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 22:55:56.363574 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.363547    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lkmb6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb","openshift-dns/node-resolver-bqxf5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal","openshift-multus/multus-additional-cni-plugins-tzp4h","openshift-multus/network-metrics-daemon-9b5l7","openshift-network-diagnostics/network-check-target-rt8pt","kube-system/global-pull-secret-syncer-j5k76","kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5nqnj","openshift-image-registry/node-ca-tbm25","openshift-multus/multus-7ph8n","openshift-network-operator/iptables-alerter-b2kn5","openshift-ovn-kubernetes/ovnkube-node-lhh8g"]
Jul 10 22:55:56.366161 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.366140    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.368345 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.368325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.369170 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.369015    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.369670 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.369445    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.369670 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.369545    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hhmqg\""
Jul 10 22:55:56.370615 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.370593    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.370709 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.370610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.370851 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.370832    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vb4r4\""
Jul 10 22:55:56.371147 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.371133    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.371313 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.371300    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 22:55:56.373038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.373020    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.373769 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.373583    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.373769 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.373613    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8gszv\""
Jul 10 22:55:56.373769 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.373588    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.374986 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.374966    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 22:55:56.375592 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.375571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6tbfw\""
Jul 10 22:55:56.375825 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.375806    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 22:55:56.376037 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.376020    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.376213 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.376199    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.376401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.376386    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 22:55:56.377054 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.377030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.377290 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.377272    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 22:55:56.378052 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.378033    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.378426 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.378133    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:55:56.378490 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.378442    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 22:55:56.379516 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.379478    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.379793 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.379778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 22:55:56.380023 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.380001    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xhgt2\""
Jul 10 22:55:56.380279 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.380255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 22:55:56.380482 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.380468    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 22:55:56.380566 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.380535    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.380618 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.380585    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:55:56.380717 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.380702    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.382358 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.382342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:56.382449 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.382410    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386406    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-run\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-etc-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-log-socket\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-cnibin\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-lib-modules\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-tmp\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/655b2489-4efa-44d8-9013-86d04e91579b-host-slash\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-systemd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-bin\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386807    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-var-lib-kubelet\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-host\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zxv4\" (UniqueName: \"kubernetes.io/projected/7733a223-4659-44bc-ae47-cffa19cd73a5-kube-api-access-8zxv4\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386926    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-env-overrides\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.386987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-script-lib\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2knr\" (UniqueName: \"kubernetes.io/projected/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-kube-api-access-g2knr\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvt5t\" (UniqueName: \"kubernetes.io/projected/61d5394c-8189-4be6-9371-5dbbd68b31ce-kube-api-access-wvt5t\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-conf\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/655b2489-4efa-44d8-9013-86d04e91579b-iptables-alerter-script\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-kubelet\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387339    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-node-log\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-config\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-systemd\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387495    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-tuned\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-systemd-units\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-var-lib-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387806    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-modprobe-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.387830 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5s8w\" (UniqueName: \"kubernetes.io/projected/e8549e16-ecbd-460f-84db-eed8f1a2627c-kube-api-access-z5s8w\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nf2g\" (UniqueName: \"kubernetes.io/projected/655b2489-4efa-44d8-9013-86d04e91579b-kube-api-access-2nf2g\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.387981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7733a223-4659-44bc-ae47-cffa19cd73a5-tmp-dir\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-netd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-os-release\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-sys\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7733a223-4659-44bc-ae47-cffa19cd73a5-hosts-file\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.388393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-slash\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.388858 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-netns\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.388858 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.388858 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.388858 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.388733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.389671 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389073    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.389671 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389491    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 22:55:56.389671 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389517    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7gtr\""
Jul 10 22:55:56.389671 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389433    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.389895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysconfig\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.389895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-kubernetes\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.389895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-ovn\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.390038 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.389909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkgv9\" (UniqueName: \"kubernetes.io/projected/030f880a-07b9-4a75-abbc-90c3bebfce2b-kube-api-access-qkgv9\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.390280 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.390261    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 22:55:56.390789 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.390771    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-km6fw\""
Jul 10 22:55:56.390880 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.390778    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 22:55:56.391306 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.391286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.393450 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393178    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 22:55:56.393450 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393254    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 22:55:56.393450 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393335    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pbg2w\""
Jul 10 22:55:56.393797 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393529    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 22:55:56.393797 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393687    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 22:55:56.393797 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.393697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.395696 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.395532    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 22:55:56.395696 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.395622    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mxr9s\""
Jul 10 22:55:56.411169 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.411143    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qcm6"
Jul 10 22:55:56.420913 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.420625    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2qcm6"
Jul 10 22:55:56.478030 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.478007    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 22:55:56.490995 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.490971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39934efb-f10a-420f-8ab5-c87ca3290580-konnectivity-ca\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvt5t\" (UniqueName: \"kubernetes.io/projected/61d5394c-8189-4be6-9371-5dbbd68b31ce-kube-api-access-wvt5t\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/655b2489-4efa-44d8-9013-86d04e91579b-iptables-alerter-script\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-kubelet\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-node-log\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-config\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491153 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-systemd-units\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-var-lib-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491209    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-node-log\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-systemd-units\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-kubelet\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491332    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-var-lib-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491401 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-os-release\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-os-release\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-socket-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491525    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nf2g\" (UniqueName: \"kubernetes.io/projected/655b2489-4efa-44d8-9013-86d04e91579b-kube-api-access-2nf2g\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7733a223-4659-44bc-ae47-cffa19cd73a5-tmp-dir\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-netns\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491595    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-multus-certs\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnz8j\" (UniqueName: \"kubernetes.io/projected/a9a83ce2-f306-4d77-aff3-acfadaf0c415-kube-api-access-hnz8j\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/655b2489-4efa-44d8-9013-86d04e91579b-iptables-alerter-script\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39934efb-f10a-420f-8ab5-c87ca3290580-agent-certs\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.491759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491740    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-config\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-binary-copy\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.491743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492086    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-sys\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7733a223-4659-44bc-ae47-cffa19cd73a5-hosts-file\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-sys\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.492183 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-socket-dir-parent\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg6tl\" (UniqueName: \"kubernetes.io/projected/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kube-api-access-fg6tl\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7733a223-4659-44bc-ae47-cffa19cd73a5-hosts-file\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492220    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dckwz\" (UniqueName: \"kubernetes.io/projected/583e521c-b87f-48e6-a8b3-6e0efe654ea4-kube-api-access-dckwz\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-etc-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492253    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7733a223-4659-44bc-ae47-cffa19cd73a5-tmp-dir\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-log-socket\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-registration-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492295    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-etc-openvswitch\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-system-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-os-release\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-log-socket\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-k8s-cni-cncf-io\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/583e521c-b87f-48e6-a8b3-6e0efe654ea4-host\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-lib-modules\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/655b2489-4efa-44d8-9013-86d04e91579b-host-slash\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.492440 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-bin\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-host\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492481    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492485    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/655b2489-4efa-44d8-9013-86d04e91579b-host-slash\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-bin\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-script-lib\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-host\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-lib-modules\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2knr\" (UniqueName: \"kubernetes.io/projected/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-kube-api-access-g2knr\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-conf\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.492999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-conf-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysctl-conf\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-systemd\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-tuned\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493115    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-systemd\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493119    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.493160 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-device-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493228    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-multus\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovnkube-script-lib\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-hostroot\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-modprobe-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5s8w\" (UniqueName: \"kubernetes.io/projected/e8549e16-ecbd-460f-84db-eed8f1a2627c-kube-api-access-z5s8w\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-netd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-cni-netd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493516    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-modprobe-d\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-kubelet\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-slash\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-netns\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.493941 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493722    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-slash\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493727    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493734    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-netns\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.493762    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-kubelet-config\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-dbus\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-system-cni-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysconfig\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493895    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-kubernetes\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.493956    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:55:56.993926892 +0000 UTC m=+2.969481888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.493988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-sysconfig\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-ovn\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkgv9\" (UniqueName: \"kubernetes.io/projected/030f880a-07b9-4a75-abbc-90c3bebfce2b-kube-api-access-qkgv9\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-kubernetes\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.494750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-ovn\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-sys-fs\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494164    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cni-binary-copy\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-daemon-config\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-run\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-cnibin\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-bin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-etc-kubernetes\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/583e521c-b87f-48e6-a8b3-6e0efe654ea4-serviceca\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494349    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-run\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494448    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-tmp\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/030f880a-07b9-4a75-abbc-90c3bebfce2b-cnibin\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-systemd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-var-lib-kubelet\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zxv4\" (UniqueName: \"kubernetes.io/projected/7733a223-4659-44bc-ae47-cffa19cd73a5-kube-api-access-8zxv4\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.495378 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-env-overrides\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.496541 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.496489    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8549e16-ecbd-460f-84db-eed8f1a2627c-var-lib-kubelet\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.496658 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.494548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-run-systemd\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.496726 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.496696    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cnibin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.496971 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.496949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/030f880a-07b9-4a75-abbc-90c3bebfce2b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.496971 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.496961    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-etc-tuned\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.497319 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.497279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-ovn-node-metrics-cert\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.497775 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.497755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-env-overrides\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.501332 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.498616    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8549e16-ecbd-460f-84db-eed8f1a2627c-tmp\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.501453 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.501430    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nf2g\" (UniqueName: \"kubernetes.io/projected/655b2489-4efa-44d8-9013-86d04e91579b-kube-api-access-2nf2g\") pod \"iptables-alerter-b2kn5\" (UID: \"655b2489-4efa-44d8-9013-86d04e91579b\") " pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.502251 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.502200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvt5t\" (UniqueName: \"kubernetes.io/projected/61d5394c-8189-4be6-9371-5dbbd68b31ce-kube-api-access-wvt5t\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:56.503380 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.503363    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2knr\" (UniqueName: \"kubernetes.io/projected/5acc81dc-0565-4b5e-ab49-a69f44edc9f8-kube-api-access-g2knr\") pod \"ovnkube-node-lhh8g\" (UID: \"5acc81dc-0565-4b5e-ab49-a69f44edc9f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.503633 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.503584    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5s8w\" (UniqueName: \"kubernetes.io/projected/e8549e16-ecbd-460f-84db-eed8f1a2627c-kube-api-access-z5s8w\") pod \"tuned-5nqnj\" (UID: \"e8549e16-ecbd-460f-84db-eed8f1a2627c\") " pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.503875 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.503842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkgv9\" (UniqueName: \"kubernetes.io/projected/030f880a-07b9-4a75-abbc-90c3bebfce2b-kube-api-access-qkgv9\") pod \"multus-additional-cni-plugins-tzp4h\" (UID: \"030f880a-07b9-4a75-abbc-90c3bebfce2b\") " pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.504574 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.504554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zxv4\" (UniqueName: \"kubernetes.io/projected/7733a223-4659-44bc-ae47-cffa19cd73a5-kube-api-access-8zxv4\") pod \"node-resolver-bqxf5\" (UID: \"7733a223-4659-44bc-ae47-cffa19cd73a5\") " pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.539629 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.539545    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal" event={"ID":"15eaeba84a5e31eea246ffc0b85b1644","Type":"ContainerStarted","Data":"ac29c08d09e06c74c6c13e1a918ffa43ab29c6d278f2d7999ab9f62644e34c23"}
Jul 10 22:55:56.597137 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnz8j\" (UniqueName: \"kubernetes.io/projected/a9a83ce2-f306-4d77-aff3-acfadaf0c415-kube-api-access-hnz8j\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.597137 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39934efb-f10a-420f-8ab5-c87ca3290580-agent-certs\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597168    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597213    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-socket-dir-parent\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg6tl\" (UniqueName: \"kubernetes.io/projected/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kube-api-access-fg6tl\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dckwz\" (UniqueName: \"kubernetes.io/projected/583e521c-b87f-48e6-a8b3-6e0efe654ea4-kube-api-access-dckwz\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.597284    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597281    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-registration-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-system-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597342    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-socket-dir-parent\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-os-release\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.597388 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.597374    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:57.097351986 +0000 UTC m=+3.072906965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-system-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-os-release\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597552    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-k8s-cni-cncf-io\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/583e521c-b87f-48e6-a8b3-6e0efe654ea4-host\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597630    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-registration-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/583e521c-b87f-48e6-a8b3-6e0efe654ea4-host\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-k8s-cni-cncf-io\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-conf-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-conf-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-device-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-multus\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597780    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-hostroot\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-device-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597797    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-kubelet\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597840    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-cni-dir\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598004 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-multus\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-kubelet\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-kubelet-config\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-dbus\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597937    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-kubelet-config\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597980    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-sys-fs\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-etc-selinux\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.597870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-hostroot\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cni-binary-copy\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-daemon-config\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e866937-5439-47a5-9207-03bf8201b071-dbus\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-bin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598084    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-etc-kubernetes\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598101    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/583e521c-b87f-48e6-a8b3-6e0efe654ea4-serviceca\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cnibin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39934efb-f10a-420f-8ab5-c87ca3290580-konnectivity-ca\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.598859 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598186    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-socket-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-netns\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-multus-certs\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-multus-certs\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cnibin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/583e521c-b87f-48e6-a8b3-6e0efe654ea4-serviceca\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-cni-binary-copy\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-sys-fs\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598756    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f3e1853a-1a06-40c2-ae91-b47129dd5c33-socket-dir\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-var-lib-cni-bin\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-host-run-netns\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39934efb-f10a-420f-8ab5-c87ca3290580-konnectivity-ca\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a9a83ce2-f306-4d77-aff3-acfadaf0c415-etc-kubernetes\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.599520 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.598931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a9a83ce2-f306-4d77-aff3-acfadaf0c415-multus-daemon-config\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.601115 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.601094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39934efb-f10a-420f-8ab5-c87ca3290580-agent-certs\") pod \"konnectivity-agent-lkmb6\" (UID: \"39934efb-f10a-420f-8ab5-c87ca3290580\") " pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.606630 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.606603    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:55:56.606630 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.606632    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:55:56.606820 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.606647    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:56.606820 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:56.606717    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:57.106699267 +0000 UTC m=+3.082254270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:56.608204 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.608182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnz8j\" (UniqueName: \"kubernetes.io/projected/a9a83ce2-f306-4d77-aff3-acfadaf0c415-kube-api-access-hnz8j\") pod \"multus-7ph8n\" (UID: \"a9a83ce2-f306-4d77-aff3-acfadaf0c415\") " pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:56.608527 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.608483    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dckwz\" (UniqueName: \"kubernetes.io/projected/583e521c-b87f-48e6-a8b3-6e0efe654ea4-kube-api-access-dckwz\") pod \"node-ca-tbm25\" (UID: \"583e521c-b87f-48e6-a8b3-6e0efe654ea4\") " pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.608988 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.608966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg6tl\" (UniqueName: \"kubernetes.io/projected/f3e1853a-1a06-40c2-ae91-b47129dd5c33-kube-api-access-fg6tl\") pod \"aws-ebs-csi-driver-node-8bbcb\" (UID: \"f3e1853a-1a06-40c2-ae91-b47129dd5c33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.689980 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.689947    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5nqnj"
Jul 10 22:55:56.698614 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.698581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b2kn5"
Jul 10 22:55:56.708200 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.708172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqxf5"
Jul 10 22:55:56.713972 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.713946    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:55:56.719758 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.719731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tzp4h"
Jul 10 22:55:56.727513 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.727475    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb"
Jul 10 22:55:56.735194 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.735177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:55:56.743750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.743726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tbm25"
Jul 10 22:55:56.749184 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:56.749166    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7ph8n"
Jul 10 22:55:57.000469 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.000435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:57.000632 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.000592    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:57.000690 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.000659    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:55:58.000639947 +0000 UTC m=+3.976194930 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:57.101686 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.101651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:57.101847 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.101820    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:57.101901 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.101891    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:58.101875933 +0000 UTC m=+4.077430912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:57.202164 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.202132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:57.202332 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.202275    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:55:57.202332 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.202291    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:55:57.202332 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.202302    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:57.202444 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.202356    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:55:58.20233909 +0000 UTC m=+4.177894071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:57.421778 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.421745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8549e16_ecbd_460f_84db_eed8f1a2627c.slice/crio-7453d8fb309d0036064aaa5dd83be2b0f6cfc90f02d8941136e5138b2762b2fb WatchSource:0}: Error finding container 7453d8fb309d0036064aaa5dd83be2b0f6cfc90f02d8941136e5138b2762b2fb: Status 404 returned error can't find the container with id 7453d8fb309d0036064aaa5dd83be2b0f6cfc90f02d8941136e5138b2762b2fb
Jul 10 22:55:57.424190 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.424164    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:50:56 +0000 UTC" deadline="2028-02-23 06:39:56.915533153 +0000 UTC"
Jul 10 22:55:57.424267 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.424191    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14215h43m59.491346339s"
Jul 10 22:55:57.443029 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.443003    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39934efb_f10a_420f_8ab5_c87ca3290580.slice/crio-86edff4258a41f6cb12a629a43b2fa2d3e412a56ec642d8e0ebf2aa38700bc71 WatchSource:0}: Error finding container 86edff4258a41f6cb12a629a43b2fa2d3e412a56ec642d8e0ebf2aa38700bc71: Status 404 returned error can't find the container with id 86edff4258a41f6cb12a629a43b2fa2d3e412a56ec642d8e0ebf2aa38700bc71
Jul 10 22:55:57.443735 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.443712    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7733a223_4659_44bc_ae47_cffa19cd73a5.slice/crio-19c306e0273a8b786c38a6405d8d831b17011f04824b7359270e49159a332154 WatchSource:0}: Error finding container 19c306e0273a8b786c38a6405d8d831b17011f04824b7359270e49159a332154: Status 404 returned error can't find the container with id 19c306e0273a8b786c38a6405d8d831b17011f04824b7359270e49159a332154
Jul 10 22:55:57.447999 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.447976    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5acc81dc_0565_4b5e_ab49_a69f44edc9f8.slice/crio-ec07dbde053d131580b054d0729ef46e3f18b786d7d622d0c0ae52c732c63611 WatchSource:0}: Error finding container ec07dbde053d131580b054d0729ef46e3f18b786d7d622d0c0ae52c732c63611: Status 404 returned error can't find the container with id ec07dbde053d131580b054d0729ef46e3f18b786d7d622d0c0ae52c732c63611
Jul 10 22:55:57.450014 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.449089    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e1853a_1a06_40c2_ae91_b47129dd5c33.slice/crio-cf96042e231e5559f3465b63452356e5f29d0f2afd61d026b9029381e151e7a1 WatchSource:0}: Error finding container cf96042e231e5559f3465b63452356e5f29d0f2afd61d026b9029381e151e7a1: Status 404 returned error can't find the container with id cf96042e231e5559f3465b63452356e5f29d0f2afd61d026b9029381e151e7a1
Jul 10 22:55:57.450014 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.449588    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583e521c_b87f_48e6_a8b3_6e0efe654ea4.slice/crio-07c85f5e1c5db8a7a862c4d410cddbdc4ea0c17cb812bc8fd638dea6a275274c WatchSource:0}: Error finding container 07c85f5e1c5db8a7a862c4d410cddbdc4ea0c17cb812bc8fd638dea6a275274c: Status 404 returned error can't find the container with id 07c85f5e1c5db8a7a862c4d410cddbdc4ea0c17cb812bc8fd638dea6a275274c
Jul 10 22:55:57.451019 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:55:57.450993    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod030f880a_07b9_4a75_abbc_90c3bebfce2b.slice/crio-2d510280d9dc3fa6a0bc16005b6fd783d9432a8b4a7ea5d7d41850d0c74b6fb4 WatchSource:0}: Error finding container 2d510280d9dc3fa6a0bc16005b6fd783d9432a8b4a7ea5d7d41850d0c74b6fb4: Status 404 returned error can't find the container with id 2d510280d9dc3fa6a0bc16005b6fd783d9432a8b4a7ea5d7d41850d0c74b6fb4
Jul 10 22:55:57.534808 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.534661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:57.534905 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:57.534891    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:55:57.547062 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.547029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb" event={"ID":"f3e1853a-1a06-40c2-ae91-b47129dd5c33","Type":"ContainerStarted","Data":"cf96042e231e5559f3465b63452356e5f29d0f2afd61d026b9029381e151e7a1"}
Jul 10 22:55:57.549273 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.549245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqxf5" event={"ID":"7733a223-4659-44bc-ae47-cffa19cd73a5","Type":"ContainerStarted","Data":"19c306e0273a8b786c38a6405d8d831b17011f04824b7359270e49159a332154"}
Jul 10 22:55:57.551649 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.551622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"ec07dbde053d131580b054d0729ef46e3f18b786d7d622d0c0ae52c732c63611"}
Jul 10 22:55:57.552976 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.552957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5nqnj" event={"ID":"e8549e16-ecbd-460f-84db-eed8f1a2627c","Type":"ContainerStarted","Data":"7453d8fb309d0036064aaa5dd83be2b0f6cfc90f02d8941136e5138b2762b2fb"}
Jul 10 22:55:57.554051 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.554032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2kn5" event={"ID":"655b2489-4efa-44d8-9013-86d04e91579b","Type":"ContainerStarted","Data":"8123139cefd4c1ac16fdc6a956ca90dd78ad3245f1882e31a16f40f244912165"}
Jul 10 22:55:57.555877 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.555859    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ph8n" event={"ID":"a9a83ce2-f306-4d77-aff3-acfadaf0c415","Type":"ContainerStarted","Data":"0662591a6306a8c5daed5dbf09e659e5799aa7637b422f0556f0f381a644da85"}
Jul 10 22:55:57.558895 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.558877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerStarted","Data":"2d510280d9dc3fa6a0bc16005b6fd783d9432a8b4a7ea5d7d41850d0c74b6fb4"}
Jul 10 22:55:57.560261 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.560242    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tbm25" event={"ID":"583e521c-b87f-48e6-a8b3-6e0efe654ea4","Type":"ContainerStarted","Data":"07c85f5e1c5db8a7a862c4d410cddbdc4ea0c17cb812bc8fd638dea6a275274c"}
Jul 10 22:55:57.562770 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.562752    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lkmb6" event={"ID":"39934efb-f10a-420f-8ab5-c87ca3290580","Type":"ContainerStarted","Data":"86edff4258a41f6cb12a629a43b2fa2d3e412a56ec642d8e0ebf2aa38700bc71"}
Jul 10 22:55:57.566523 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.566481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal" event={"ID":"15eaeba84a5e31eea246ffc0b85b1644","Type":"ContainerStarted","Data":"cfdd01b5022f05f5347a55e456c419eec6cfb9ce032cd4eeddd889764b6cb192"}
Jul 10 22:55:57.581393 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:57.581350    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-179.ec2.internal" podStartSLOduration=2.581336907 podStartE2EDuration="2.581336907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:55:57.580719719 +0000 UTC m=+3.556274722" watchObservedRunningTime="2026-07-10 22:55:57.581336907 +0000 UTC m=+3.556891909"
Jul 10 22:55:58.008198 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.008150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:58.008396 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.008358    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:58.008464 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.008426    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:56:00.008405764 +0000 UTC m=+5.983960747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:55:58.108822 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.108783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:58.109010 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.108925    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:58.109010 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.109001    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:00.108980261 +0000 UTC m=+6.084535267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:55:58.210085 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.210047    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:58.210748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.210272    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:55:58.210748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.210297    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:55:58.210748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.210310    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:58.210748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.210375    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:00.210354611 +0000 UTC m=+6.185909591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:55:58.425356 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.425255    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:50:56 +0000 UTC" deadline="2028-04-22 08:30:11.41857108 +0000 UTC"
Jul 10 22:55:58.425356 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.425316    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15633h34m12.993258843s"
Jul 10 22:55:58.536464 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.536416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:55:58.536660 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.536574    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:55:58.536752 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.536710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:55:58.536799 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:58.536787    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:55:58.582318 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.582063    2558 generic.go:356] "Generic (PLEG): container finished" podID="a7afc97894006e5c326a420b9300dbbc" containerID="e63cc40abe09a05dc28ef2e479083d957c0ad8974d6715b92aa4c9ab35e13a97" exitCode=0
Jul 10 22:55:58.583461 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:58.583253    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal" event={"ID":"a7afc97894006e5c326a420b9300dbbc","Type":"ContainerDied","Data":"e63cc40abe09a05dc28ef2e479083d957c0ad8974d6715b92aa4c9ab35e13a97"}
Jul 10 22:55:59.534702 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:59.534163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:55:59.534702 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:55:59.534296    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:55:59.597522 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:59.594093    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal" event={"ID":"a7afc97894006e5c326a420b9300dbbc","Type":"ContainerStarted","Data":"da6e8e88483df6edd4d73ec14926aead0d3a0c35f9b62eb6259d432a007f27ec"}
Jul 10 22:55:59.612353 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:55:59.612230    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-179.ec2.internal" podStartSLOduration=4.612208438 podStartE2EDuration="4.612208438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:55:59.611304368 +0000 UTC m=+5.586859373" watchObservedRunningTime="2026-07-10 22:55:59.612208438 +0000 UTC m=+5.587763442"
Jul 10 22:56:00.025593 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:00.025541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:00.025783 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.025740    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:00.025846 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.025817    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:56:04.025796744 +0000 UTC m=+10.001351725 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:00.126261 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:00.126222    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:00.126452 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.126370    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:00.126452 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.126436    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:04.126416838 +0000 UTC m=+10.101971822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:00.226876 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:00.226836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:00.227192 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.227159    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:56:00.227192 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.227187    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:56:00.227398 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.227202    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:00.227398 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.227262    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:04.227242513 +0000 UTC m=+10.202797496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:00.534665 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:00.534630    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:00.534853 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.534767    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:00.535231 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:00.535196    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:00.535319 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:00.535297    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:01.534055 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:01.534011    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:01.534237 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:01.534173    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:02.534567 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:02.534519    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:02.535023 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:02.534670    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:02.535152 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:02.535124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:02.535257 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:02.535238    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:03.535086 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:03.534802    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:03.535086 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:03.534974    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:04.060019 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:04.059846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:04.060019 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.059994    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:04.060265 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.060082    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:56:12.060061873 +0000 UTC m=+18.035616853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:04.161193 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:04.161150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:04.161363 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.161331    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:04.161449 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.161422    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:12.161399872 +0000 UTC m=+18.136954857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:04.262347 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:04.262295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:04.262536 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.262496    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:56:04.262622 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.262544    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:56:04.262622 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.262557    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:04.262725 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.262642    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:12.262621064 +0000 UTC m=+18.238176060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:04.535133 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:04.535047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:04.535133 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:04.535098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:04.535686 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.535195    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:04.535686 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:04.535662    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:05.534794 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:05.534752    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:05.534996 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:05.534879    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:06.534981 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:06.534939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:06.535428 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:06.534956    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:06.535428 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:06.535088    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:06.535428 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:06.535151    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:07.534551 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:07.534062    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:07.534551 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:07.534188    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:08.534199 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:08.534163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:08.534668 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:08.534163    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:08.534668 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:08.534286    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:08.534668 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:08.534413    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:09.534265 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:09.534224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:09.534735 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:09.534369    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:10.537491 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:10.537453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:10.537912 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:10.537530    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:10.537912 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:10.537620    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:10.537912 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:10.537715    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:11.534908 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:11.534871    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:11.535098 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:11.535025    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:12.126590 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:12.126551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:12.127057 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.126713    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:12.127057 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.126801    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:56:28.126778469 +0000 UTC m=+34.102333473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:12.227871 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:12.227833    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:12.228054 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.227977    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:12.228054 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.228045    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:28.22802827 +0000 UTC m=+34.203583250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:12.328840 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:12.328798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:12.328999 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.328972    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:56:12.329048 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.329002    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:56:12.329048 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.329018    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:12.329163 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.329085    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:28.329065356 +0000 UTC m=+34.304620339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:12.537856 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:12.537826    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:12.538023 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.537964    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:12.538083 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:12.538015    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:12.538144 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:12.538128    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:13.534747 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:13.534712    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:13.535200 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:13.534850    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:14.535838 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:14.535798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:14.536284 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:14.536004    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:14.536570 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:14.536550    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:14.536770 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:14.536749    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:15.534347 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:15.534301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:15.534556 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:15.534449    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:16.534733 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.534560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:16.535441 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.534560    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:16.535441 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:16.534815    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:16.535441 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:16.534922    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:16.630195 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.630152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7ph8n" event={"ID":"a9a83ce2-f306-4d77-aff3-acfadaf0c415","Type":"ContainerStarted","Data":"cfa33bf62d2dc0fbd41a93ae61af78213ed97fd0f4d3a214b7fb6c50c5c1926f"}
Jul 10 22:56:16.631959 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.631895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerStarted","Data":"5196b99e1b78d5f317b6f5fffc456b877bed649674d0baa47d42f753aa83bf5c"}
Jul 10 22:56:16.636762 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.636737    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tbm25" event={"ID":"583e521c-b87f-48e6-a8b3-6e0efe654ea4","Type":"ContainerStarted","Data":"e05148cf011a3a298e6224c2b465802a449309b1295f89ac235e9bd1110c873e"}
Jul 10 22:56:16.638402 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.638375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lkmb6" event={"ID":"39934efb-f10a-420f-8ab5-c87ca3290580","Type":"ContainerStarted","Data":"2ca1507bc41e81f5c31979c40035d357970680b69e8da933d6dcd0b6a001c9df"}
Jul 10 22:56:16.639892 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.639866    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb" event={"ID":"f3e1853a-1a06-40c2-ae91-b47129dd5c33","Type":"ContainerStarted","Data":"19f204ba93bad4c689d6bb2fd2eef6bb0e5e05462d404160b7b7008cb7f7ec13"}
Jul 10 22:56:16.641412 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.641389    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqxf5" event={"ID":"7733a223-4659-44bc-ae47-cffa19cd73a5","Type":"ContainerStarted","Data":"500f7cebbc290c16eb50ef22e56980b4d78bece10ce828eea40c214700a17dee"}
Jul 10 22:56:16.643345 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.643321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"b9ae9089ff5806fa2b92a357aaa02e88138a25ebc199a80641c142f266b3aac7"}
Jul 10 22:56:16.644768 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.644743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5nqnj" event={"ID":"e8549e16-ecbd-460f-84db-eed8f1a2627c","Type":"ContainerStarted","Data":"beef7cdd109d49f7c957680e9a32426ebb95ac985ac5a72b4b0d878ef713b6c2"}
Jul 10 22:56:16.647642 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.647601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7ph8n" podStartSLOduration=3.775019145 podStartE2EDuration="22.647589344s" totalImagesPullingTime="18.872570199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:16.646856006 +0000 UTC m=+22.622411007" watchObservedRunningTime="2026-07-10 22:56:16.647589344 +0000 UTC m=+22.623144346"
Jul 10 22:56:16.661655 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.661603    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tbm25" podStartSLOduration=3.8073542 podStartE2EDuration="22.661588205s" totalImagesPullingTime="18.854234005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:16.661168357 +0000 UTC m=+22.636723360" watchObservedRunningTime="2026-07-10 22:56:16.661588205 +0000 UTC m=+22.637143207"
Jul 10 22:56:16.674078 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.674028    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bqxf5" podStartSLOduration=3.814187065 podStartE2EDuration="22.674011559s" totalImagesPullingTime="18.859824494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:16.673795258 +0000 UTC m=+22.649350259" watchObservedRunningTime="2026-07-10 22:56:16.674011559 +0000 UTC m=+22.649566561"
Jul 10 22:56:16.692259 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.692210    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5nqnj" podStartSLOduration=3.824929459 podStartE2EDuration="22.692195008s" totalImagesPullingTime="18.867265549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:16.691770666 +0000 UTC m=+22.667325669" watchObservedRunningTime="2026-07-10 22:56:16.692195008 +0000 UTC m=+22.667750049"
Jul 10 22:56:16.734075 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:16.733932    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lkmb6" podStartSLOduration=12.206503138 podStartE2EDuration="22.733917769s" totalImagesPullingTime="10.527414631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:16.733796669 +0000 UTC m=+22.709351670" watchObservedRunningTime="2026-07-10 22:56:16.733917769 +0000 UTC m=+22.709472771"
Jul 10 22:56:17.534532 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.534485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:17.534728 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:17.534620    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:17.535298 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.535279    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 22:56:17.649129 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.649094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb" event={"ID":"f3e1853a-1a06-40c2-ae91-b47129dd5c33","Type":"ContainerStarted","Data":"eb8c71a52abe4fcd749f9de1402cf8f9f6c36cd4dfaa05bdb7028aa926502bb1"}
Jul 10 22:56:17.651845 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.651825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 22:56:17.652172 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652153    2558 generic.go:356] "Generic (PLEG): container finished" podID="5acc81dc-0565-4b5e-ab49-a69f44edc9f8" containerID="3860b18d13c6439cf2e75f216885e73cefd5b87aa80da3de31e583183b2b709a" exitCode=1
Jul 10 22:56:17.652248 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652223    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerDied","Data":"3860b18d13c6439cf2e75f216885e73cefd5b87aa80da3de31e583183b2b709a"}
Jul 10 22:56:17.652305 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652289    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"a091731d1d4d5e90af1fa90c46201053fbf2441b89f97ecbcbc751754960da32"}
Jul 10 22:56:17.652346 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"4021953cd29f287f18054d35ec9a5b466784358c29fa31c1bf5cbd73751a170a"}
Jul 10 22:56:17.652388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"f81fd81c7460aa0a8b7c277bb44965c024f94fbc0cdffb2674d016a300414b96"}
Jul 10 22:56:17.652421 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.652409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"b8c95c1aeb9d921ceb114e8f77eede5f26dbbea188f44a8bb5b5641324eff296"}
Jul 10 22:56:17.653675 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.653652    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="5196b99e1b78d5f317b6f5fffc456b877bed649674d0baa47d42f753aa83bf5c" exitCode=0
Jul 10 22:56:17.653776 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:17.653752    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"5196b99e1b78d5f317b6f5fffc456b877bed649674d0baa47d42f753aa83bf5c"}
Jul 10 22:56:18.447713 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.447060    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T22:56:17.535294658Z","UUID":"e4dd354a-2737-4d17-acb1-7ec1eb9937a9","Handler":null,"Name":"","Endpoint":""}
Jul 10 22:56:18.448661 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.448636    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 22:56:18.448748 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.448682    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 22:56:18.534388 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.534359    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:18.534568 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:18.534464    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:18.534568 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.534522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:18.534651 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:18.534603    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:18.658740 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.658709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb" event={"ID":"f3e1853a-1a06-40c2-ae91-b47129dd5c33","Type":"ContainerStarted","Data":"8229ae13b75e230323877dcc894bda789252cc77866a942b1a8fcbcaf15d9284"}
Jul 10 22:56:18.660539 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.660487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b2kn5" event={"ID":"655b2489-4efa-44d8-9013-86d04e91579b","Type":"ContainerStarted","Data":"7a7d2a50637985c3609b51e4f7dd1aebb2b230f353ec8ce249d17c400e6acd60"}
Jul 10 22:56:18.674355 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.674314    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8bbcb" podStartSLOduration=4.112957908 podStartE2EDuration="24.674299845s" totalImagesPullingTime="20.561341937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:18.67408586 +0000 UTC m=+24.649640863" watchObservedRunningTime="2026-07-10 22:56:18.674299845 +0000 UTC m=+24.649854846"
Jul 10 22:56:18.686770 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.686722    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b2kn5" podStartSLOduration=5.853212367 podStartE2EDuration="24.68670669s" totalImagesPullingTime="18.833494323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:18.68618597 +0000 UTC m=+24.661740974" watchObservedRunningTime="2026-07-10 22:56:18.68670669 +0000 UTC m=+24.662261691"
Jul 10 22:56:18.922052 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.921938    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:56:18.922491 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:18.922468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:56:19.534149 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:19.534114    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:19.534362 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:19.534245    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:19.667158 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:19.667128    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 22:56:19.667612 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:19.667576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"227b333f8d780c1e64f2832fb5eb52a04d8b9d3970fc4866a1bb222fbaeb2a6f"}
Jul 10 22:56:20.534020 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:20.533986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:20.534224 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:20.534129    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:20.534905 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:20.534884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:20.535017 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:20.534976    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:21.534794 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:21.534709    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:21.535452 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:21.534852    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:22.534759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.534569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:22.534914 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.534569    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:22.534914 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:22.534838    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:22.535292 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:22.534948    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:22.678145 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678118    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 22:56:22.678519 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"8f8c7c2c95440ae5f294ac29681cb67224c44301ba0917f71eb2de5b273a50c7"}
Jul 10 22:56:22.678789 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678763    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:56:22.678909 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678844    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:56:22.678909 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:56:22.679025 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.678945    2558 scope.go:117] "RemoveContainer" containerID="3860b18d13c6439cf2e75f216885e73cefd5b87aa80da3de31e583183b2b709a"
Jul 10 22:56:22.681455 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.681430    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="762c9acab10cef722d1295b2f8c19c3939e63fb4053aef03f050533be62283d4" exitCode=0
Jul 10 22:56:22.681603 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.681467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"762c9acab10cef722d1295b2f8c19c3939e63fb4053aef03f050533be62283d4"}
Jul 10 22:56:22.699750 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.699722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:56:22.699900 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:22.699887    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:56:23.534396 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.534363    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:23.534569 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:23.534545    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:23.688121 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.688099    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 22:56:23.688547 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.688521    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" event={"ID":"5acc81dc-0565-4b5e-ab49-a69f44edc9f8","Type":"ContainerStarted","Data":"2dc432ef5df62ae1d2d5571cd26b1c71e92ad90cc729a0ee092a66bc313be998"}
Jul 10 22:56:23.690735 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.690711    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="b587139aefe9bd9dd118984209086eefc3170d628031e552307cbc5769516a78" exitCode=0
Jul 10 22:56:23.690836 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.690767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"b587139aefe9bd9dd118984209086eefc3170d628031e552307cbc5769516a78"}
Jul 10 22:56:23.715651 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:23.715595    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g" podStartSLOduration=10.800642949 podStartE2EDuration="29.715580744s" totalImagesPullingTime="18.914937795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:23.7152221 +0000 UTC m=+29.690777112" watchObservedRunningTime="2026-07-10 22:56:23.715580744 +0000 UTC m=+29.691135745"
Jul 10 22:56:24.090080 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.089657    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:56:24.090278 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.090115    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 22:56:24.090415 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.090379    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lkmb6"
Jul 10 22:56:24.157577 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.157471    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5k76"]
Jul 10 22:56:24.157708 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.157629    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:24.157741 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:24.157716    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:24.161117 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.161091    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rt8pt"]
Jul 10 22:56:24.161241 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.161202    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:24.161319 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:24.161293    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:24.161805 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.161781    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b5l7"]
Jul 10 22:56:24.161915 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.161891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:24.162021 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:24.161997    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:24.695425 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.695393    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="cad3100c0d734b6d67a2d142860612101c7dc7aee4a89c54ac577cb695bb6cb4" exitCode=0
Jul 10 22:56:24.696079 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:24.695476    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"cad3100c0d734b6d67a2d142860612101c7dc7aee4a89c54ac577cb695bb6cb4"}
Jul 10 22:56:25.534482 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:25.534445    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:25.534671 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:25.534485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:25.534671 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:25.534619    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:25.534788 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:25.534673    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:25.534788 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:25.534731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:25.534852 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:25.534819    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:27.534313 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:27.534277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:27.534936 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:27.534315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:27.534936 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:27.534315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:27.534936 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:27.534397    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rt8pt" podUID="c5d68103-739e-4261-84e2-7ec9757ed351"
Jul 10 22:56:27.534936 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:27.534490    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:56:27.534936 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:27.534583    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j5k76" podUID="4e866937-5439-47a5-9207-03bf8201b071"
Jul 10 22:56:28.140806 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:28.140766    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:28.141031 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.140948    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:28.141085 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.141032    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:57:00.141008832 +0000 UTC m=+66.116563820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:56:28.241974 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:28.241941    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:28.242174 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.242048    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:28.242174 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.242108    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret podName:4e866937-5439-47a5-9207-03bf8201b071 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:00.242090457 +0000 UTC m=+66.217645438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret") pod "global-pull-secret-syncer-j5k76" (UID: "4e866937-5439-47a5-9207-03bf8201b071") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:56:28.342585 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:28.342548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:28.342748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.342694    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:56:28.342748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.342714    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:56:28.342748 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.342723    2558 projected.go:196] Error preparing data for projected volume kube-api-access-f29rd for pod openshift-network-diagnostics/network-check-target-rt8pt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:28.342867 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:28.342788    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd podName:c5d68103-739e-4261-84e2-7ec9757ed351 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:00.342768826 +0000 UTC m=+66.318323829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f29rd" (UniqueName: "kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd") pod "network-check-target-rt8pt" (UID: "c5d68103-739e-4261-84e2-7ec9757ed351") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:56:29.378775 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.378548    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-179.ec2.internal" event="NodeReady"
Jul 10 22:56:29.379130 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.378836    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 22:56:29.426271 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.426237    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8dgzv"]
Jul 10 22:56:29.442412 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.442371    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqz6"]
Jul 10 22:56:29.442948 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.442626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.444759 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.444736    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5n6l\""
Jul 10 22:56:29.445001 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.444985    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 22:56:29.445064 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.445039    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 22:56:29.456366 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.456343    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8dgzv"]
Jul 10 22:56:29.456451 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.456376    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqz6"]
Jul 10 22:56:29.456451 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.456416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.458730 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.458702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ld9cp\""
Jul 10 22:56:29.458730 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.458715    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 22:56:29.458869 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.458730    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 22:56:29.458869 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.458785    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 22:56:29.534210 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.534176    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:56:29.534372 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.534215    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:56:29.534372 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.534215    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:56:29.536685 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.536650    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 22:56:29.536838 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.536718    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 22:56:29.536838 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.536738    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 22:56:29.536838 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.536739    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cgdm\""
Jul 10 22:56:29.537122 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.537106    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jr855\""
Jul 10 22:56:29.537202 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.537107    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 22:56:29.549749 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549727    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-cert\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.549850 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-config-volume\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.549850 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-tmp-dir\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.549850 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pntff\" (UniqueName: \"kubernetes.io/projected/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-kube-api-access-pntff\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.549850 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8q7d\" (UniqueName: \"kubernetes.io/projected/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-kube-api-access-j8q7d\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.549970 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.549900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.650962 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.650930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pntff\" (UniqueName: \"kubernetes.io/projected/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-kube-api-access-pntff\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.651092 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.650961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8q7d\" (UniqueName: \"kubernetes.io/projected/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-kube-api-access-j8q7d\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.651092 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.651164 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:29.651151    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:29.651238 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651212    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-cert\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.651289 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:29.651270    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:30.151238385 +0000 UTC m=+36.126793372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:29.651349 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-config-volume\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.651349 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651334    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-tmp-dir\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.651643 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651625    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-tmp-dir\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.651878 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.651863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-config-volume\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.655037 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.655016    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-cert\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.659044 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.659025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pntff\" (UniqueName: \"kubernetes.io/projected/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-kube-api-access-pntff\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:29.659296 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.659276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8q7d\" (UniqueName: \"kubernetes.io/projected/a6ecc746-4c7c-4ef6-8630-fc7686b7f827-kube-api-access-j8q7d\") pod \"ingress-canary-ggqz6\" (UID: \"a6ecc746-4c7c-4ef6-8630-fc7686b7f827\") " pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.711454 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.711430    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="25c464ce8aa97b6afd844c048a5a7a555032bab21c920421d5d75691bc778504" exitCode=0
Jul 10 22:56:29.711575 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.711486    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"25c464ce8aa97b6afd844c048a5a7a555032bab21c920421d5d75691bc778504"}
Jul 10 22:56:29.764409 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.764364    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ggqz6"
Jul 10 22:56:29.946080 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:29.946051    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ggqz6"]
Jul 10 22:56:29.988334 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:56:29.988301    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ecc746_4c7c_4ef6_8630_fc7686b7f827.slice/crio-9c3e2767ab6ea124a6bca56fd47d74a252476b1bc4e360c1f534b17f122839a1 WatchSource:0}: Error finding container 9c3e2767ab6ea124a6bca56fd47d74a252476b1bc4e360c1f534b17f122839a1: Status 404 returned error can't find the container with id 9c3e2767ab6ea124a6bca56fd47d74a252476b1bc4e360c1f534b17f122839a1
Jul 10 22:56:30.156814 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:30.156735    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:30.156954 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:30.156851    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:30.156954 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:30.156905    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:31.156890246 +0000 UTC m=+37.132445227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:30.718410 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:30.718374    2558 generic.go:356] "Generic (PLEG): container finished" podID="030f880a-07b9-4a75-abbc-90c3bebfce2b" containerID="3772cb1ae3e5b4a9d0b67ae1f36c6ca04242f0ee80e3d40d68d89b683662aa57" exitCode=0
Jul 10 22:56:30.718840 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:30.718459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerDied","Data":"3772cb1ae3e5b4a9d0b67ae1f36c6ca04242f0ee80e3d40d68d89b683662aa57"}
Jul 10 22:56:30.720098 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:30.720062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqz6" event={"ID":"a6ecc746-4c7c-4ef6-8630-fc7686b7f827","Type":"ContainerStarted","Data":"9c3e2767ab6ea124a6bca56fd47d74a252476b1bc4e360c1f534b17f122839a1"}
Jul 10 22:56:31.164360 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:31.164147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:31.164564 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:31.164312    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:31.164564 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:31.164483    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:33.164462368 +0000 UTC m=+39.140017348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:31.725565 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:31.725532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" event={"ID":"030f880a-07b9-4a75-abbc-90c3bebfce2b","Type":"ContainerStarted","Data":"96596ed6cef99b5942463034cc1d01be48d48868670f4ae1683c0d85246d109a"}
Jul 10 22:56:31.746568 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:31.746491    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tzp4h" podStartSLOduration=9.130688682 podStartE2EDuration="37.746471767s" totalImagesPullingTime="28.615783085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:31.745346339 +0000 UTC m=+37.720901340" watchObservedRunningTime="2026-07-10 22:56:31.746471767 +0000 UTC m=+37.722026768"
Jul 10 22:56:32.730104 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:32.730069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ggqz6" event={"ID":"a6ecc746-4c7c-4ef6-8630-fc7686b7f827","Type":"ContainerStarted","Data":"bbb2e071ad3392c36fd840107d0eae80fee1f339f148313040697acd637ea07a"}
Jul 10 22:56:32.744186 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:32.744111    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ggqz6" podStartSLOduration=1.097088332 podStartE2EDuration="3.744093728s" totalImagesPullingTime="2.647005396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:56:32.743613198 +0000 UTC m=+38.719168211" watchObservedRunningTime="2026-07-10 22:56:32.744093728 +0000 UTC m=+38.719648707"
Jul 10 22:56:33.182802 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:33.182760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:33.183002 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:33.182939    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:33.183070 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:33.183017    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:37.182995928 +0000 UTC m=+43.158550909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:37.210869 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:37.210826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:37.211393 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:37.210995    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:37.211393 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:37.211066    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:56:45.211049578 +0000 UTC m=+51.186604559 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:45.269092 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:45.269053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:56:45.269576 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:45.269191    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:56:45.269576 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:56:45.269246    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:01.269231437 +0000 UTC m=+67.244786416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:56:54.706693 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:56:54.706666    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhh8g"
Jul 10 22:57:00.170311 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.170268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:57:00.172840 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.172821    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 22:57:00.180683 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:00.180664    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 22:57:00.180739 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:00.180728    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 22:58:04.180711485 +0000 UTC m=+130.156266465 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : secret "metrics-daemon-secret" not found
Jul 10 22:57:00.271539 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.271494    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:57:00.274031 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.274014    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 22:57:00.285373 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.285346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e866937-5439-47a5-9207-03bf8201b071-original-pull-secret\") pod \"global-pull-secret-syncer-j5k76\" (UID: \"4e866937-5439-47a5-9207-03bf8201b071\") " pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:57:00.372582 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.372545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:57:00.374847 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.374831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 22:57:00.385946 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.385922    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 22:57:00.396206 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.396181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f29rd\" (UniqueName: \"kubernetes.io/projected/c5d68103-739e-4261-84e2-7ec9757ed351-kube-api-access-f29rd\") pod \"network-check-target-rt8pt\" (UID: \"c5d68103-739e-4261-84e2-7ec9757ed351\") " pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:57:00.446351 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.446290    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cgdm\""
Jul 10 22:57:00.449133 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.449117    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j5k76"
Jul 10 22:57:00.454251 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.454234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:57:00.628357 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.628329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j5k76"]
Jul 10 22:57:00.632169 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:57:00.632139    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e866937_5439_47a5_9207_03bf8201b071.slice/crio-238e5cf8a92ff28f28f1b752138529b17f18bd9fc2fb24ed46eb1f8b10750f73 WatchSource:0}: Error finding container 238e5cf8a92ff28f28f1b752138529b17f18bd9fc2fb24ed46eb1f8b10750f73: Status 404 returned error can't find the container with id 238e5cf8a92ff28f28f1b752138529b17f18bd9fc2fb24ed46eb1f8b10750f73
Jul 10 22:57:00.647081 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.647049    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rt8pt"]
Jul 10 22:57:00.649578 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:57:00.649557    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d68103_739e_4261_84e2_7ec9757ed351.slice/crio-20d442b3b8795f30beba109d6344e059dc91b162fd6513668138977a0913a305 WatchSource:0}: Error finding container 20d442b3b8795f30beba109d6344e059dc91b162fd6513668138977a0913a305: Status 404 returned error can't find the container with id 20d442b3b8795f30beba109d6344e059dc91b162fd6513668138977a0913a305
Jul 10 22:57:00.798178 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.798090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5k76" event={"ID":"4e866937-5439-47a5-9207-03bf8201b071","Type":"ContainerStarted","Data":"238e5cf8a92ff28f28f1b752138529b17f18bd9fc2fb24ed46eb1f8b10750f73"}
Jul 10 22:57:00.799144 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:00.799114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rt8pt" event={"ID":"c5d68103-739e-4261-84e2-7ec9757ed351","Type":"ContainerStarted","Data":"20d442b3b8795f30beba109d6344e059dc91b162fd6513668138977a0913a305"}
Jul 10 22:57:01.278814 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:01.278775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:57:01.279291 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:01.278962    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:57:01.279291 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:01.279027    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:57:33.279008705 +0000 UTC m=+99.254563689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:57:05.814528 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:05.814477    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rt8pt" event={"ID":"c5d68103-739e-4261-84e2-7ec9757ed351","Type":"ContainerStarted","Data":"758a72b4a3fb84f73622166fd585249fa3ad0403fb237ebe0d68a42e6032e472"}
Jul 10 22:57:05.814965 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:05.814585    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:57:05.815946 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:05.815923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j5k76" event={"ID":"4e866937-5439-47a5-9207-03bf8201b071","Type":"ContainerStarted","Data":"b4f56c1edf397ae01bc66e283e1ea3d241fedb13c16b8a38c1a1bd0e5d130069"}
Jul 10 22:57:05.829863 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:05.829820    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rt8pt" podStartSLOduration=67.332200612 podStartE2EDuration="1m11.829805912s" totalImagesPullingTime="4.4976053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:57:05.829265398 +0000 UTC m=+71.804820400" watchObservedRunningTime="2026-07-10 22:57:05.829805912 +0000 UTC m=+71.805360910"
Jul 10 22:57:05.845997 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:05.845935    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j5k76" podStartSLOduration=67.327111063 podStartE2EDuration="1m11.845916703s" totalImagesPullingTime="4.51880564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:57:05.845304404 +0000 UTC m=+71.820859405" watchObservedRunningTime="2026-07-10 22:57:05.845916703 +0000 UTC m=+71.821471707"
Jul 10 22:57:14.987335 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.987216    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"]
Jul 10 22:57:14.990237 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.990218    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"]
Jul 10 22:57:14.990368 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.990350    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:14.992643 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.992622    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 22:57:14.992643 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.992637    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 22:57:14.992799 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.992659    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 22:57:14.992799 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.992704    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 22:57:14.993035 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.993016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:14.995134 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.995116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 10 22:57:14.995238 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.995148    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 10 22:57:14.995533 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.995516    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 10 22:57:14.995630 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.995587    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 10 22:57:14.999527 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:14.999482    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"]
Jul 10 22:57:15.000423 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.000396    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"]
Jul 10 22:57:15.078752 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-klusterlet-config\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.078916 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078776    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-tmp\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.078916 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.079042 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk5lc\" (UniqueName: \"kubernetes.io/projected/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-kube-api-access-pk5lc\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.079042 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078958    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.079042 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.078992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.079042 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.079017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fw7q\" (UniqueName: \"kubernetes.io/projected/582106d1-bf31-4d24-a653-105aa12ef725-kube-api-access-6fw7q\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.079192 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.079049    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/582106d1-bf31-4d24-a653-105aa12ef725-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.079192 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.079068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.179481 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179451    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/582106d1-bf31-4d24-a653-105aa12ef725-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.179606 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.179662 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-klusterlet-config\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.179715 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-tmp\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.179757 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179729    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.179798 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk5lc\" (UniqueName: \"kubernetes.io/projected/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-kube-api-access-pk5lc\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.179847 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179808    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.179847 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.179836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.180148 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.180122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-tmp\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.180303 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.180202    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/582106d1-bf31-4d24-a653-105aa12ef725-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.180447 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.180233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fw7q\" (UniqueName: \"kubernetes.io/projected/582106d1-bf31-4d24-a653-105aa12ef725-kube-api-access-6fw7q\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.182536 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.182488    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-klusterlet-config\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.182768 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.182748    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.182875 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.182857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.182948 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.182929    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-hub\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.182983 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.182972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/582106d1-bf31-4d24-a653-105aa12ef725-ca\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.187625 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.187604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fw7q\" (UniqueName: \"kubernetes.io/projected/582106d1-bf31-4d24-a653-105aa12ef725-kube-api-access-6fw7q\") pod \"cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv\" (UID: \"582106d1-bf31-4d24-a653-105aa12ef725\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.187726 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.187660    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk5lc\" (UniqueName: \"kubernetes.io/projected/4ad1d4b7-ee23-41a3-a948-ad131ce59a10-kube-api-access-pk5lc\") pod \"klusterlet-addon-workmgr-d49f8fb97-kn592\" (UID: \"4ad1d4b7-ee23-41a3-a948-ad131ce59a10\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.300896 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.300806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:15.319918 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.319892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 22:57:15.436800 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.436769    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"]
Jul 10 22:57:15.440237 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:57:15.440209    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad1d4b7_ee23_41a3_a948_ad131ce59a10.slice/crio-e49d94f121676cab21c2e8b67cc3956e86a9c6ed19582e5a26c7f1ca5ccc461e WatchSource:0}: Error finding container e49d94f121676cab21c2e8b67cc3956e86a9c6ed19582e5a26c7f1ca5ccc461e: Status 404 returned error can't find the container with id e49d94f121676cab21c2e8b67cc3956e86a9c6ed19582e5a26c7f1ca5ccc461e
Jul 10 22:57:15.454163 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.454140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"]
Jul 10 22:57:15.457087 ip-10-0-139-179 kubenswrapper[2558]: W0710 22:57:15.457065    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod582106d1_bf31_4d24_a653_105aa12ef725.slice/crio-dae99395246ba895d26ffcf3dd193312162b679b62ef259d9f9c91ee5cc35413 WatchSource:0}: Error finding container dae99395246ba895d26ffcf3dd193312162b679b62ef259d9f9c91ee5cc35413: Status 404 returned error can't find the container with id dae99395246ba895d26ffcf3dd193312162b679b62ef259d9f9c91ee5cc35413
Jul 10 22:57:15.842840 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.842798    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" event={"ID":"4ad1d4b7-ee23-41a3-a948-ad131ce59a10","Type":"ContainerStarted","Data":"e49d94f121676cab21c2e8b67cc3956e86a9c6ed19582e5a26c7f1ca5ccc461e"}
Jul 10 22:57:15.843741 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:15.843717    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerStarted","Data":"dae99395246ba895d26ffcf3dd193312162b679b62ef259d9f9c91ee5cc35413"}
Jul 10 22:57:20.861713 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.861605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" event={"ID":"4ad1d4b7-ee23-41a3-a948-ad131ce59a10","Type":"ContainerStarted","Data":"ffa6a9b6110e61148c04703a77eb0a119f688d8a51600aaeca50fe263d28af28"}
Jul 10 22:57:20.862178 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.861781    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:20.863399 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.863371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:57:20.863807 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.863781    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerStarted","Data":"bebaaa0cfc4de9a9bcf3dfe46c7cbe62342e9972e9bd1fff5d525f42023d9188"}
Jul 10 22:57:20.863902 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.863821    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerStarted","Data":"af70daf75fc034f5729ff46445c7465eb9e6de78eeb752b9a423afca811e1026"}
Jul 10 22:57:20.863902 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.863838    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerStarted","Data":"dd42c50fe899c6ba762d752828b17dacd7744bb4b3d09b20ce1d192d83604e30"}
Jul 10 22:57:20.877082 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.877041    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" podStartSLOduration=1.7936050620000001 podStartE2EDuration="6.877029077s" totalImagesPullingTime="5.083424015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:57:20.876276901 +0000 UTC m=+86.851831904" watchObservedRunningTime="2026-07-10 22:57:20.877029077 +0000 UTC m=+86.852584117"
Jul 10 22:57:20.894673 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:20.894630    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" podStartSLOduration=1.8256494330000002 podStartE2EDuration="6.894619022s" totalImagesPullingTime="5.068969589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:57:20.893849735 +0000 UTC m=+86.869404737" watchObservedRunningTime="2026-07-10 22:57:20.894619022 +0000 UTC m=+86.870174023"
Jul 10 22:57:33.313925 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:33.313865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:57:33.314446 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:33.314024    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:57:33.314446 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:57:33.314140    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 22:58:37.314123191 +0000 UTC m=+163.289678170 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:57:36.822898 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:57:36.822867    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rt8pt"
Jul 10 22:58:04.238009 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:58:04.237955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:58:04.238489 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:04.238116    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 22:58:04.238489 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:04.238195    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 23:00:06.238178172 +0000 UTC m=+252.213733151 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : secret "metrics-daemon-secret" not found
Jul 10 22:58:32.453153 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:32.453085    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8dgzv" podUID="14f360c4-9f10-4f2b-97ad-29e5bbfa9776"
Jul 10 22:58:32.554692 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:32.554633    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 22:58:33.061660 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:58:33.061622    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:58:37.360782 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:58:37.360740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 22:58:37.361211 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:37.360909    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 22:58:37.361211 ip-10-0-139-179 kubenswrapper[2558]: E0710 22:58:37.360985    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls podName:14f360c4-9f10-4f2b-97ad-29e5bbfa9776 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:39.360970406 +0000 UTC m=+285.336525396 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls") pod "dns-default-8dgzv" (UID: "14f360c4-9f10-4f2b-97ad-29e5bbfa9776") : secret "dns-default-metrics-tls" not found
Jul 10 22:58:46.534343 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:58:46.534245    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 22:59:20.862496 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:20.862421    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" podUID="4ad1d4b7-ee23-41a3-a948-ad131ce59a10" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 10 22:59:21.194141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:21.194107    2558 generic.go:356] "Generic (PLEG): container finished" podID="4ad1d4b7-ee23-41a3-a948-ad131ce59a10" containerID="ffa6a9b6110e61148c04703a77eb0a119f688d8a51600aaeca50fe263d28af28" exitCode=1
Jul 10 22:59:21.194310 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:21.194172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" event={"ID":"4ad1d4b7-ee23-41a3-a948-ad131ce59a10","Type":"ContainerDied","Data":"ffa6a9b6110e61148c04703a77eb0a119f688d8a51600aaeca50fe263d28af28"}
Jul 10 22:59:21.194519 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:21.194491    2558 scope.go:117] "RemoveContainer" containerID="ffa6a9b6110e61148c04703a77eb0a119f688d8a51600aaeca50fe263d28af28"
Jul 10 22:59:22.199663 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:22.199627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592" event={"ID":"4ad1d4b7-ee23-41a3-a948-ad131ce59a10","Type":"ContainerStarted","Data":"ed73a127597a3ad7d077f171486bbcaa463f39b761205a5cc26262f56638e81d"}
Jul 10 22:59:22.200141 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:22.199911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 22:59:22.200548 ip-10-0-139-179 kubenswrapper[2558]: I0710 22:59:22.200533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-d49f8fb97-kn592"
Jul 10 23:00:06.284594 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:06.284554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 23:00:06.285089 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:06.284680    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 23:00:06.285089 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:06.284744    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs podName:61d5394c-8189-4be6-9371-5dbbd68b31ce nodeName:}" failed. No retries permitted until 2026-07-10 23:02:08.284729421 +0000 UTC m=+374.260284401 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs") pod "network-metrics-daemon-9b5l7" (UID: "61d5394c-8189-4be6-9371-5dbbd68b31ce") : secret "metrics-daemon-secret" not found
Jul 10 23:00:12.442910 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.442874    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ql24w"]
Jul 10 23:00:12.445004 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.444986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.447348 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.447315    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 23:00:12.447621 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.447607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q2bn6\""
Jul 10 23:00:12.448188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.448172    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 23:00:12.448271 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.448256    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 23:00:12.448312 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.448264    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 23:00:12.475182 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.475148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ql24w"]
Jul 10 23:00:12.524808 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.524770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.524808 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.524814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.525049 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.524834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rfb4\" (UniqueName: \"kubernetes.io/projected/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-api-access-9rfb4\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.525049 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.524859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f97cfa18-fc9b-4db4-88b4-1942a43908b9-crio-socket\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.525049 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.524935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f97cfa18-fc9b-4db4-88b4-1942a43908b9-data-volume\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.625913 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.625867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.625913 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.625916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.625936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rfb4\" (UniqueName: \"kubernetes.io/projected/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-api-access-9rfb4\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.625972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f97cfa18-fc9b-4db4-88b4-1942a43908b9-crio-socket\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.626002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f97cfa18-fc9b-4db4-88b4-1942a43908b9-data-volume\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:12.626018    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:12.626026    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:12.626086    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:13.126068517 +0000 UTC m=+259.101623497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:12.626101    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:13.126094274 +0000 UTC m=+259.101649254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : configmap "kube-rbac-proxy" not found
Jul 10 23:00:12.626153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.626128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f97cfa18-fc9b-4db4-88b4-1942a43908b9-crio-socket\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.626436 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.626309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f97cfa18-fc9b-4db4-88b4-1942a43908b9-data-volume\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:12.637552 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:12.637523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rfb4\" (UniqueName: \"kubernetes.io/projected/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-api-access-9rfb4\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:13.130561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:13.130486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:13.130561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:13.130568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:13.130786 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:13.130636    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 23:00:13.130786 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:13.130641    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:13.130786 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:13.130687    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.130674166 +0000 UTC m=+260.106229147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : configmap "kube-rbac-proxy" not found
Jul 10 23:00:13.130786 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:13.130706    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:14.13069319 +0000 UTC m=+260.106248170 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:14.137447 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:14.137414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:14.137447 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:14.137456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:14.137910 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:14.137565    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 23:00:14.137910 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:14.137570    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:14.137910 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:14.137624    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:16.13760506 +0000 UTC m=+262.113160040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:14.137910 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:14.137645    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:16.137638071 +0000 UTC m=+262.113193050 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : configmap "kube-rbac-proxy" not found
Jul 10 23:00:15.031549 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:15.031465    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqxf5_7733a223-4659-44bc-ae47-cffa19cd73a5/dns-node-resolver/0.log"
Jul 10 23:00:16.152622 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:16.152587    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:16.152622 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:16.152628    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:16.153040 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:16.152702    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 23:00:16.153040 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:16.152727    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:16.153040 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:16.152756    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:20.152739836 +0000 UTC m=+266.128294818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : configmap "kube-rbac-proxy" not found
Jul 10 23:00:16.153040 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:16.152786    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:20.15277386 +0000 UTC m=+266.128328840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:16.432185 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:16.432113    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tbm25_583e521c-b87f-48e6-a8b3-6e0efe654ea4/node-ca/0.log"
Jul 10 23:00:17.229883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:17.229854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqz6_a6ecc746-4c7c-4ef6-8630-fc7686b7f827/serve-healthcheck-canary/0.log"
Jul 10 23:00:20.178563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:20.178527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:20.178563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:20.178571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:20.179082 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:20.178666    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 23:00:20.179082 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:20.178687    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:20.179082 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:20.178721    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:28.178706372 +0000 UTC m=+274.154261352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : configmap "kube-rbac-proxy" not found
Jul 10 23:00:20.179082 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:20.178759    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls podName:f97cfa18-fc9b-4db4-88b4-1942a43908b9 nodeName:}" failed. No retries permitted until 2026-07-10 23:00:28.178744163 +0000 UTC m=+274.154299143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ql24w" (UID: "f97cfa18-fc9b-4db4-88b4-1942a43908b9") : secret "insights-runtime-extractor-tls" not found
Jul 10 23:00:28.238761 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.238707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:28.239243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.238807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:28.239243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.239222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f97cfa18-fc9b-4db4-88b4-1942a43908b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:28.241194 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.241174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f97cfa18-fc9b-4db4-88b4-1942a43908b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ql24w\" (UID: \"f97cfa18-fc9b-4db4-88b4-1942a43908b9\") " pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:28.352934 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.352879    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ql24w"
Jul 10 23:00:28.479343 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:28.479316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ql24w"]
Jul 10 23:00:28.482482 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:00:28.482453    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97cfa18_fc9b_4db4_88b4_1942a43908b9.slice/crio-2d3ae5b2cd81fca2747cb5bd037365a16ac8422967873144b6bf6f3fe86bd585 WatchSource:0}: Error finding container 2d3ae5b2cd81fca2747cb5bd037365a16ac8422967873144b6bf6f3fe86bd585: Status 404 returned error can't find the container with id 2d3ae5b2cd81fca2747cb5bd037365a16ac8422967873144b6bf6f3fe86bd585
Jul 10 23:00:29.391727 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:29.391629    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql24w" event={"ID":"f97cfa18-fc9b-4db4-88b4-1942a43908b9","Type":"ContainerStarted","Data":"2d3ae5b2cd81fca2747cb5bd037365a16ac8422967873144b6bf6f3fe86bd585"}
Jul 10 23:00:33.409460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:33.409425    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql24w" event={"ID":"f97cfa18-fc9b-4db4-88b4-1942a43908b9","Type":"ContainerStarted","Data":"1b8c40110ca7c012bba2e7878859d19b70a8b4b129948e275efcc8007f78cb9c"}
Jul 10 23:00:33.409926 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:33.409518    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql24w" event={"ID":"f97cfa18-fc9b-4db4-88b4-1942a43908b9","Type":"ContainerStarted","Data":"ca112b9e45b015b9cca1875cb21abfa66a5d3b4c5c11a56a193082818135afe6"}
Jul 10 23:00:36.063042 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:36.062941    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8dgzv" podUID="14f360c4-9f10-4f2b-97ad-29e5bbfa9776"
Jul 10 23:00:36.419751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:36.419719    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:36.419751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:36.419743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ql24w" event={"ID":"f97cfa18-fc9b-4db4-88b4-1942a43908b9","Type":"ContainerStarted","Data":"4dc3cf7ff29461c90f9afd2bde8e2c25678ee6c4ac7992f2b61cbfaddc465ecb"}
Jul 10 23:00:36.436365 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:36.436319    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ql24w" podStartSLOduration=17.385407858 podStartE2EDuration="24.436303242s" totalImagesPullingTime="7.050895384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 23:00:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:36.434610455 +0000 UTC m=+282.410165459" watchObservedRunningTime="2026-07-10 23:00:36.436303242 +0000 UTC m=+282.411858243"
Jul 10 23:00:38.651827 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.651788    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76c7469587-zq4bw"]
Jul 10 23:00:38.654742 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.654726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.657123 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.657095    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 23:00:38.657288 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.657269    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 23:00:38.657876 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.657857    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 23:00:38.657974 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.657894    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-67lgp\""
Jul 10 23:00:38.666380 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.666361    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 23:00:38.669345 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.669320    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c7469587-zq4bw"]
Jul 10 23:00:38.719489 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2j6\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-kube-api-access-qg2j6\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719643 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-bound-sa-token\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719643 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719564    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-image-registry-private-configuration\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719643 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/446d09d2-443a-4822-8a60-67f329b9ca6b-ca-trust-extracted\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-tls\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-certificates\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719730    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-installation-pull-secrets\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.719854 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.719762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-trusted-ca\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.820698 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.820671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-certificates\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.820698 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.820701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-installation-pull-secrets\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.820893 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.820721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-trusted-ca\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.820936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.820915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2j6\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-kube-api-access-qg2j6\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.820989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.820973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-bound-sa-token\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821043 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-image-registry-private-configuration\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821090 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821050    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/446d09d2-443a-4822-8a60-67f329b9ca6b-ca-trust-extracted\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821090 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-tls\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821463 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/446d09d2-443a-4822-8a60-67f329b9ca6b-ca-trust-extracted\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-certificates\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.821695 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.821677    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/446d09d2-443a-4822-8a60-67f329b9ca6b-trusted-ca\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.823561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.823544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-registry-tls\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.823874 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.823859    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-installation-pull-secrets\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.824032 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.824001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/446d09d2-443a-4822-8a60-67f329b9ca6b-image-registry-private-configuration\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.832371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.832341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-bound-sa-token\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.832600 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.832583    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2j6\" (UniqueName: \"kubernetes.io/projected/446d09d2-443a-4822-8a60-67f329b9ca6b-kube-api-access-qg2j6\") pod \"image-registry-76c7469587-zq4bw\" (UID: \"446d09d2-443a-4822-8a60-67f329b9ca6b\") " pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:38.963305 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:38.963218    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:39.086029 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.085995    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76c7469587-zq4bw"]
Jul 10 23:00:39.088971 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:00:39.088940    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446d09d2_443a_4822_8a60_67f329b9ca6b.slice/crio-3b38d7ed40af27c966c0b576b27f6b383d07ef1b65b88c73d3feb80f857b9244 WatchSource:0}: Error finding container 3b38d7ed40af27c966c0b576b27f6b383d07ef1b65b88c73d3feb80f857b9244: Status 404 returned error can't find the container with id 3b38d7ed40af27c966c0b576b27f6b383d07ef1b65b88c73d3feb80f857b9244
Jul 10 23:00:39.424279 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.424250    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:39.426824 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.426803    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f360c4-9f10-4f2b-97ad-29e5bbfa9776-metrics-tls\") pod \"dns-default-8dgzv\" (UID: \"14f360c4-9f10-4f2b-97ad-29e5bbfa9776\") " pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:39.429948 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.429917    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c7469587-zq4bw" event={"ID":"446d09d2-443a-4822-8a60-67f329b9ca6b","Type":"ContainerStarted","Data":"dd0be2c315cf5c3d004b3dac1bbea598dd942eb4aab5b27d1505a8bb54db60dc"}
Jul 10 23:00:39.430049 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.429973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76c7469587-zq4bw" event={"ID":"446d09d2-443a-4822-8a60-67f329b9ca6b","Type":"ContainerStarted","Data":"3b38d7ed40af27c966c0b576b27f6b383d07ef1b65b88c73d3feb80f857b9244"}
Jul 10 23:00:39.430049 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.430008    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:00:39.447384 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.447339    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76c7469587-zq4bw" podStartSLOduration=1.447325482 podStartE2EDuration="1.447325482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:39.446407317 +0000 UTC m=+285.421962319" watchObservedRunningTime="2026-07-10 23:00:39.447325482 +0000 UTC m=+285.422880538"
Jul 10 23:00:39.723102 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.723015    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5n6l\""
Jul 10 23:00:39.730939 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.730913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:39.857008 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:39.856973    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8dgzv"]
Jul 10 23:00:39.860300 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:00:39.860268    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f360c4_9f10_4f2b_97ad_29e5bbfa9776.slice/crio-1a03d6c12a41c16a2a58293b0f6954adcac8c9cc24dc0d8b0a10a6bd2db0b6a7 WatchSource:0}: Error finding container 1a03d6c12a41c16a2a58293b0f6954adcac8c9cc24dc0d8b0a10a6bd2db0b6a7: Status 404 returned error can't find the container with id 1a03d6c12a41c16a2a58293b0f6954adcac8c9cc24dc0d8b0a10a6bd2db0b6a7
Jul 10 23:00:40.435191 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:40.435153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dgzv" event={"ID":"14f360c4-9f10-4f2b-97ad-29e5bbfa9776","Type":"ContainerStarted","Data":"1a03d6c12a41c16a2a58293b0f6954adcac8c9cc24dc0d8b0a10a6bd2db0b6a7"}
Jul 10 23:00:42.443445 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:42.443411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dgzv" event={"ID":"14f360c4-9f10-4f2b-97ad-29e5bbfa9776","Type":"ContainerStarted","Data":"124f7c9b94e1455a8a17fe688070a7950f071c1d89c6a08efe773300d663f6d9"}
Jul 10 23:00:42.443853 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:42.443463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8dgzv" event={"ID":"14f360c4-9f10-4f2b-97ad-29e5bbfa9776","Type":"ContainerStarted","Data":"dfae0b0b52483402827b5d9abed2ac32d0664f2544222b9d1b5d20882aab0e81"}
Jul 10 23:00:42.443853 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:42.443545    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:42.458124 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:42.458047    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8dgzv" podStartSLOduration=251.913994677 podStartE2EDuration="4m13.458029012s" totalImagesPullingTime="1.544034335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:42.457760884 +0000 UTC m=+288.433315886" watchObservedRunningTime="2026-07-10 23:00:42.458029012 +0000 UTC m=+288.433584014"
Jul 10 23:00:45.321545 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:45.321486    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" podUID="582106d1-bf31-4d24-a653-105aa12ef725" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 10 23:00:47.051242 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.051205    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4thzz"]
Jul 10 23:00:47.056025 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.055995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.058717 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.058692    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 23:00:47.058717 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.058706    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 23:00:47.058900 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.058820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 23:00:47.059585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.059566    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 23:00:47.059585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.059577    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 23:00:47.059737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.059583    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 23:00:47.059737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.059571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m25jt\""
Jul 10 23:00:47.184050 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184000    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-root\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184050 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-sys\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-wtmp\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184098    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-accelerators-collector-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-textfile\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-tls\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-metrics-client-ca\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.184262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.184255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567vb\" (UniqueName: \"kubernetes.io/projected/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-kube-api-access-567vb\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284825 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284793    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-567vb\" (UniqueName: \"kubernetes.io/projected/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-kube-api-access-567vb\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-root\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-sys\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-wtmp\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-accelerators-collector-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284940    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-textfile\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284956    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-tls\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-root\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.284993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.284993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-sys\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-metrics-client-ca\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-wtmp\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-textfile\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285626 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285596    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-metrics-client-ca\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.285744 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.285692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-accelerators-collector-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.287564 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.287546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.287669 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.287652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-node-exporter-tls\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.292748 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.292725    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-567vb\" (UniqueName: \"kubernetes.io/projected/b266fcdc-598f-4f9a-b5d0-58b5eebbd723-kube-api-access-567vb\") pod \"node-exporter-4thzz\" (UID: \"b266fcdc-598f-4f9a-b5d0-58b5eebbd723\") " pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.364950 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.364854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4thzz"
Jul 10 23:00:47.375319 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:00:47.375284    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb266fcdc_598f_4f9a_b5d0_58b5eebbd723.slice/crio-5ac731352d473becbe3d27a91d68caca010027722b93022921b6ddaa62ac0646 WatchSource:0}: Error finding container 5ac731352d473becbe3d27a91d68caca010027722b93022921b6ddaa62ac0646: Status 404 returned error can't find the container with id 5ac731352d473becbe3d27a91d68caca010027722b93022921b6ddaa62ac0646
Jul 10 23:00:47.460046 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:47.459997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4thzz" event={"ID":"b266fcdc-598f-4f9a-b5d0-58b5eebbd723","Type":"ContainerStarted","Data":"5ac731352d473becbe3d27a91d68caca010027722b93022921b6ddaa62ac0646"}
Jul 10 23:00:49.470259 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:49.470218    2558 generic.go:356] "Generic (PLEG): container finished" podID="b266fcdc-598f-4f9a-b5d0-58b5eebbd723" containerID="51527d3154ff73d5ddacc6bf958fe65339eec6a61a2328ce0e67cf4a4949f567" exitCode=0
Jul 10 23:00:49.470672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:49.470279    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4thzz" event={"ID":"b266fcdc-598f-4f9a-b5d0-58b5eebbd723","Type":"ContainerDied","Data":"51527d3154ff73d5ddacc6bf958fe65339eec6a61a2328ce0e67cf4a4949f567"}
Jul 10 23:00:49.535559 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:00:49.535518    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9b5l7" podUID="61d5394c-8189-4be6-9371-5dbbd68b31ce"
Jul 10 23:00:50.475225 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:50.475178    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4thzz" event={"ID":"b266fcdc-598f-4f9a-b5d0-58b5eebbd723","Type":"ContainerStarted","Data":"d72fde3e8dfe2afee37ebd500a159e3399f8935ced97b89e0a481c1da5d925fc"}
Jul 10 23:00:50.475741 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:50.475240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4thzz" event={"ID":"b266fcdc-598f-4f9a-b5d0-58b5eebbd723","Type":"ContainerStarted","Data":"0bb5df5568bbef76fbdd7149e8c7384fac89d55f2196a10c9fe3081ebd2cd334"}
Jul 10 23:00:50.493325 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:50.493268    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4thzz" podStartSLOduration=2.268318495 podStartE2EDuration="3.493251728s" totalImagesPullingTime="1.151432257s" totalInitContainerRuntime="73.500976ms" isStatefulPod=true podCreationTimestamp="2026-07-10 23:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:50.49238926 +0000 UTC m=+296.467944266" watchObservedRunningTime="2026-07-10 23:00:50.493251728 +0000 UTC m=+296.468806730"
Jul 10 23:00:52.238326 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.238293    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-758497588f-4dzg5"]
Jul 10 23:00:52.241311 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.241293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.243287 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.243265    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 23:00:52.244002 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.243980    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vvxff\""
Jul 10 23:00:52.244002 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.243997    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 23:00:52.244189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.244014    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 23:00:52.244189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.244014    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 23:00:52.244189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.243983    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 23:00:52.248994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.248973    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 23:00:52.253256 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.253237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-758497588f-4dzg5"]
Jul 10 23:00:52.327549 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-metrics-client-ca\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327549 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-federate-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plf2z\" (UniqueName: \"kubernetes.io/projected/cac288e9-6b6a-4d4a-b278-302f8737c8a0-kube-api-access-plf2z\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-serving-certs-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.327775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.327762    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428577 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plf2z\" (UniqueName: \"kubernetes.io/projected/cac288e9-6b6a-4d4a-b278-302f8737c8a0-kube-api-access-plf2z\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428577 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-serving-certs-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-metrics-client-ca\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428726    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-federate-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.428839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.428754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.429476 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.429446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-serving-certs-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.429854 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.429554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-metrics-client-ca\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.430061 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.430034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.431557 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.431534    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-telemeter-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.431666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.431536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-federate-client-tls\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.431716 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.431706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.431780 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.431758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cac288e9-6b6a-4d4a-b278-302f8737c8a0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.437375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.437344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plf2z\" (UniqueName: \"kubernetes.io/projected/cac288e9-6b6a-4d4a-b278-302f8737c8a0-kube-api-access-plf2z\") pod \"telemeter-client-758497588f-4dzg5\" (UID: \"cac288e9-6b6a-4d4a-b278-302f8737c8a0\") " pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.448953 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.448933    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8dgzv"
Jul 10 23:00:52.551237 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.551152    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5"
Jul 10 23:00:52.685893 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:52.685864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-758497588f-4dzg5"]
Jul 10 23:00:52.688019 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:00:52.687992    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac288e9_6b6a_4d4a_b278_302f8737c8a0.slice/crio-9ec0992609d6800d8aa23054f176753804ca15e5c8466bd6f3715c4738d02eb6 WatchSource:0}: Error finding container 9ec0992609d6800d8aa23054f176753804ca15e5c8466bd6f3715c4738d02eb6: Status 404 returned error can't find the container with id 9ec0992609d6800d8aa23054f176753804ca15e5c8466bd6f3715c4738d02eb6
Jul 10 23:00:53.486599 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:53.486557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5" event={"ID":"cac288e9-6b6a-4d4a-b278-302f8737c8a0","Type":"ContainerStarted","Data":"9ec0992609d6800d8aa23054f176753804ca15e5c8466bd6f3715c4738d02eb6"}
Jul 10 23:00:54.693311 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:54.693280    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:00:54.695627 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:54.693410    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:00:54.696436 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:54.696419    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 23:00:55.321083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:55.321044    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" podUID="582106d1-bf31-4d24-a653-105aa12ef725" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 10 23:00:55.497270 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:55.497231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5" event={"ID":"cac288e9-6b6a-4d4a-b278-302f8737c8a0","Type":"ContainerStarted","Data":"0b5a2f792ab88061d17f6d14b8f5d9ad98695ed2f7a2e9ba1fedc665d2951063"}
Jul 10 23:00:56.502657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:56.502619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5" event={"ID":"cac288e9-6b6a-4d4a-b278-302f8737c8a0","Type":"ContainerStarted","Data":"a7badec3bbf0548e0b380fd28b11ff9009d20d5a559e9da4bfbc67cd051369e1"}
Jul 10 23:00:56.503063 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:56.502676    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5" event={"ID":"cac288e9-6b6a-4d4a-b278-302f8737c8a0","Type":"ContainerStarted","Data":"bee9ea6ff5a5b494b3352153bcd07bade4f9f38f5018e25c1dbbb0a8cd6a2eed"}
Jul 10 23:00:56.530283 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:00:56.530231    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-758497588f-4dzg5" podStartSLOduration=1.249134996 podStartE2EDuration="4.53021648s" totalImagesPullingTime="3.281081484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:00:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:00:56.528779354 +0000 UTC m=+302.504334356" watchObservedRunningTime="2026-07-10 23:00:56.53021648 +0000 UTC m=+302.505771481"
Jul 10 23:01:00.072464 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.072428    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:01:00.075605 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.075590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.079359 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.079337    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 23:01:00.079947 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.079928    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 23:01:00.080121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.080096    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 23:01:00.080301 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.080285    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 23:01:00.081083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.081031    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kbq4z\""
Jul 10 23:01:00.081083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.081054    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 23:01:00.081083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.081070    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 23:01:00.081426 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.081409    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 23:01:00.084228 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.084208    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 23:01:00.092410 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.092392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:01:00.196235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp9xc\" (UniqueName: \"kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.196484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.196404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297628 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297628 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297627    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp9xc\" (UniqueName: \"kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.297880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.297812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.298471 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.298419    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.298781 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.298476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.298781 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.298674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.298781 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.298717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.300280 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.300259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.300422 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.300405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.305814 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.305794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp9xc\" (UniqueName: \"kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc\") pod \"console-8f5fcd8b8-qs8wt\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") " pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.385974 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.385939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:00.440449 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.440419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76c7469587-zq4bw"
Jul 10 23:01:00.544848 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.540403    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:01:00.546076 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:00.546055    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:01:01.522718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:01.522673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5fcd8b8-qs8wt" event={"ID":"adf963ff-bc2d-45f6-ba2a-22239a418d37","Type":"ContainerStarted","Data":"0edb41f35532cf72d019bca3fcc8d9fd9619adcd2eef8b5d2ba2885f9533b90a"}
Jul 10 23:01:03.532081 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:03.532029    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5fcd8b8-qs8wt" event={"ID":"adf963ff-bc2d-45f6-ba2a-22239a418d37","Type":"ContainerStarted","Data":"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"}
Jul 10 23:01:03.551603 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:03.551551    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8f5fcd8b8-qs8wt" podStartSLOduration=0.962074162 podStartE2EDuration="3.551532845s" totalImagesPullingTime="2.589458683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:01:03.550800763 +0000 UTC m=+309.526355765" watchObservedRunningTime="2026-07-10 23:01:03.551532845 +0000 UTC m=+309.527087844"
Jul 10 23:01:04.535815 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:04.535779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 23:01:05.321355 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.321315    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" podUID="582106d1-bf31-4d24-a653-105aa12ef725" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 10 23:01:05.321542 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.321397    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv"
Jul 10 23:01:05.321922 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.321889    2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bebaaa0cfc4de9a9bcf3dfe46c7cbe62342e9972e9bd1fff5d525f42023d9188"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 10 23:01:05.321959 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.321942    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" podUID="582106d1-bf31-4d24-a653-105aa12ef725" containerName="service-proxy" containerID="cri-o://bebaaa0cfc4de9a9bcf3dfe46c7cbe62342e9972e9bd1fff5d525f42023d9188" gracePeriod=30
Jul 10 23:01:05.542755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.542722    2558 generic.go:356] "Generic (PLEG): container finished" podID="582106d1-bf31-4d24-a653-105aa12ef725" containerID="bebaaa0cfc4de9a9bcf3dfe46c7cbe62342e9972e9bd1fff5d525f42023d9188" exitCode=2
Jul 10 23:01:05.543119 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.542788    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerDied","Data":"bebaaa0cfc4de9a9bcf3dfe46c7cbe62342e9972e9bd1fff5d525f42023d9188"}
Jul 10 23:01:05.543119 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:05.542822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b6cbb44c5-6w5vv" event={"ID":"582106d1-bf31-4d24-a653-105aa12ef725","Type":"ContainerStarted","Data":"b7647bc0b0cdae0a426d3923fc64373b643fafbcaf07a41253fe24e810b29d5a"}
Jul 10 23:01:10.386705 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:10.386669    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:10.387239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:10.386950    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:10.391488 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:10.391470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:01:10.562858 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:01:10.562831    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:02:07.620860 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.620783    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:02:07.624071 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.624050    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.636864 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.636808    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:02:07.720558 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720487    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720558 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjj2\" (UniqueName: \"kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.720798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.720734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.821848 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.821811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.821848 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.821854    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.821873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjj2\" (UniqueName: \"kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.821945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.821995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822020    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822040    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822675 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822801 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822867 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822813    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.822867 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.822852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.825077 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.825053    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.825274 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.825252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.829868 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.829842    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjj2\" (UniqueName: \"kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2\") pod \"console-b6cb65fb-b8rcf\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") " pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:07.938864 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:07.938812    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:08.069185 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.069017    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:02:08.071889 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:02:08.071865    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7416389_81ed_43b7_a504_3e811940874c.slice/crio-d74bb4b8bdf09e016fcdb44679f3099952ae62921f523155367763297c4ee3c6 WatchSource:0}: Error finding container d74bb4b8bdf09e016fcdb44679f3099952ae62921f523155367763297c4ee3c6: Status 404 returned error can't find the container with id d74bb4b8bdf09e016fcdb44679f3099952ae62921f523155367763297c4ee3c6
Jul 10 23:02:08.326479 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.326388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 23:02:08.328880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.328854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61d5394c-8189-4be6-9371-5dbbd68b31ce-metrics-certs\") pod \"network-metrics-daemon-9b5l7\" (UID: \"61d5394c-8189-4be6-9371-5dbbd68b31ce\") " pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 23:02:08.439616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.439581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jr855\""
Jul 10 23:02:08.447268 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.447244    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b5l7"
Jul 10 23:02:08.573289 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.573259    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b5l7"]
Jul 10 23:02:08.576012 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:02:08.575990    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d5394c_8189_4be6_9371_5dbbd68b31ce.slice/crio-d97d07735f9de596d91a51587b8e10ea09d1c4372a71b3d1357bda2d0bd5ea99 WatchSource:0}: Error finding container d97d07735f9de596d91a51587b8e10ea09d1c4372a71b3d1357bda2d0bd5ea99: Status 404 returned error can't find the container with id d97d07735f9de596d91a51587b8e10ea09d1c4372a71b3d1357bda2d0bd5ea99
Jul 10 23:02:08.750680 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.750644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5l7" event={"ID":"61d5394c-8189-4be6-9371-5dbbd68b31ce","Type":"ContainerStarted","Data":"d97d07735f9de596d91a51587b8e10ea09d1c4372a71b3d1357bda2d0bd5ea99"}
Jul 10 23:02:08.752153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.752128    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cb65fb-b8rcf" event={"ID":"d7416389-81ed-43b7-a504-3e811940874c","Type":"ContainerStarted","Data":"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"}
Jul 10 23:02:08.752275 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.752171    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cb65fb-b8rcf" event={"ID":"d7416389-81ed-43b7-a504-3e811940874c","Type":"ContainerStarted","Data":"d74bb4b8bdf09e016fcdb44679f3099952ae62921f523155367763297c4ee3c6"}
Jul 10 23:02:08.768187 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:08.768144    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6cb65fb-b8rcf" podStartSLOduration=1.768128352 podStartE2EDuration="1.768128352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:02:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:02:08.766947257 +0000 UTC m=+374.742502259" watchObservedRunningTime="2026-07-10 23:02:08.768128352 +0000 UTC m=+374.743683354"
Jul 10 23:02:10.761778 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:10.761743    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5l7" event={"ID":"61d5394c-8189-4be6-9371-5dbbd68b31ce","Type":"ContainerStarted","Data":"cf5450a14dbd9e8145f6c0baba28e9261a704e4744c51dfa2f409a32d1a1110f"}
Jul 10 23:02:10.762171 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:10.761796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b5l7" event={"ID":"61d5394c-8189-4be6-9371-5dbbd68b31ce","Type":"ContainerStarted","Data":"f363b48812548ab8443539af78a09184e4a9f22e4f04e934b163b774c3468075"}
Jul 10 23:02:10.777744 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:10.777700    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9b5l7" podStartSLOduration=375.385293494 podStartE2EDuration="6m16.777685814s" totalImagesPullingTime="1.39239232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:02:10.775993657 +0000 UTC m=+376.751548660" watchObservedRunningTime="2026-07-10 23:02:10.777685814 +0000 UTC m=+376.753240816"
Jul 10 23:02:17.939223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:17.939166    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:17.939650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:17.939251    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:17.944106 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:17.944070    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:18.793728 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:18.793692    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:02:18.836496 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:18.836466    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:02:43.858024 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:43.857964    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8f5fcd8b8-qs8wt" podUID="adf963ff-bc2d-45f6-ba2a-22239a418d37" containerName="console" containerID="cri-o://7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263" gracePeriod=15
Jul 10 23:02:44.100172 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.100147    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:02:44.189622 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189593    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp9xc\" (UniqueName: \"kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189622 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189662    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189700    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.189883 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.189759    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config\") pod \"adf963ff-bc2d-45f6-ba2a-22239a418d37\" (UID: \"adf963ff-bc2d-45f6-ba2a-22239a418d37\") "
Jul 10 23:02:44.190146 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.190117    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:02:44.190236 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.190208    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:02:44.190302 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.190215    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config" (OuterVolumeSpecName: "console-config") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:02:44.190302 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.190234    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca" (OuterVolumeSpecName: "service-ca") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:02:44.192135 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.192103    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:02:44.192249 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.192132    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:02:44.192249 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.192139    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc" (OuterVolumeSpecName: "kube-api-access-hp9xc") pod "adf963ff-bc2d-45f6-ba2a-22239a418d37" (UID: "adf963ff-bc2d-45f6-ba2a-22239a418d37"). InnerVolumeSpecName "kube-api-access-hp9xc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:02:44.290734 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290699    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-oauth-serving-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290734 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290729    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-serving-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290734 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290738    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-oauth-config\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290962 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290748    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-console-config\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290962 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290756    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp9xc\" (UniqueName: \"kubernetes.io/projected/adf963ff-bc2d-45f6-ba2a-22239a418d37-kube-api-access-hp9xc\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290962 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290764    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-trusted-ca-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.290962 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.290772    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adf963ff-bc2d-45f6-ba2a-22239a418d37-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:02:44.878689 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.878603    2558 generic.go:356] "Generic (PLEG): container finished" podID="adf963ff-bc2d-45f6-ba2a-22239a418d37" containerID="7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263" exitCode=0
Jul 10 23:02:44.878689 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.878655    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8f5fcd8b8-qs8wt"
Jul 10 23:02:44.879178 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.878685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5fcd8b8-qs8wt" event={"ID":"adf963ff-bc2d-45f6-ba2a-22239a418d37","Type":"ContainerDied","Data":"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"}
Jul 10 23:02:44.879178 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.878732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8f5fcd8b8-qs8wt" event={"ID":"adf963ff-bc2d-45f6-ba2a-22239a418d37","Type":"ContainerDied","Data":"0edb41f35532cf72d019bca3fcc8d9fd9619adcd2eef8b5d2ba2885f9533b90a"}
Jul 10 23:02:44.879178 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.878752    2558 scope.go:117] "RemoveContainer" containerID="7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"
Jul 10 23:02:44.887325 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.887304    2558 scope.go:117] "RemoveContainer" containerID="7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"
Jul 10 23:02:44.887593 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:02:44.887574    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263\": container with ID starting with 7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263 not found: ID does not exist" containerID="7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"
Jul 10 23:02:44.887671 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.887607    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263"} err="failed to get container status \"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263\": rpc error: code = NotFound desc = could not find container \"7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263\": container with ID starting with 7b90fe7eadab3c923ded64d8258cf4856a7c4b9b18b4d5b12af5d9bc2e36a263 not found: ID does not exist"
Jul 10 23:02:44.897904 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.897883    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:02:44.901295 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:44.901277    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8f5fcd8b8-qs8wt"]
Jul 10 23:02:46.538227 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:02:46.538195    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adf963ff-bc2d-45f6-ba2a-22239a418d37" path="/var/lib/kubelet/pods/adf963ff-bc2d-45f6-ba2a-22239a418d37/volumes"
Jul 10 23:03:24.824283 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.824201    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"]
Jul 10 23:03:24.824752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.824438    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adf963ff-bc2d-45f6-ba2a-22239a418d37" containerName="console"
Jul 10 23:03:24.824752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.824448    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="adf963ff-bc2d-45f6-ba2a-22239a418d37" containerName="console"
Jul 10 23:03:24.824752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.824489    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="adf963ff-bc2d-45f6-ba2a-22239a418d37" containerName="console"
Jul 10 23:03:24.827233 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.827217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:24.829456 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.829430    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z8v4s\""
Jul 10 23:03:24.829456 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.829454    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 23:03:24.830159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.830138    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 23:03:24.835483 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:24.835459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"]
Jul 10 23:03:25.001959 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.001928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.002162 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.002007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6c9f\" (UniqueName: \"kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.002162 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.002053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.102844 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.102758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6c9f\" (UniqueName: \"kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.102844 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.102810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.103022 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.102866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.103267 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.103244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.103303 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.103262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.110787 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.110766    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6c9f\" (UniqueName: \"kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.136675 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.136649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:25.268425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:25.268391    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"]
Jul 10 23:03:26.020064 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:26.020017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k" event={"ID":"08805159-b168-43da-a87b-d703b467968c","Type":"ContainerStarted","Data":"b5c9918a6a6a28aa2e6ab521ab9e4e5880563a13a62c218dea5bd3f1e073b9ab"}
Jul 10 23:03:32.044036 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:32.044004    2558 generic.go:356] "Generic (PLEG): container finished" podID="08805159-b168-43da-a87b-d703b467968c" containerID="880b2fc69ea3432a28d03251a2b4449cfdf0b63e81f98c6dc41605cee46c0ac8" exitCode=0
Jul 10 23:03:32.044437 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:32.044095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k" event={"ID":"08805159-b168-43da-a87b-d703b467968c","Type":"ContainerDied","Data":"880b2fc69ea3432a28d03251a2b4449cfdf0b63e81f98c6dc41605cee46c0ac8"}
Jul 10 23:03:35.057296 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:35.057264    2558 generic.go:356] "Generic (PLEG): container finished" podID="08805159-b168-43da-a87b-d703b467968c" containerID="2149c988a6f3f281e33d9c6935d5a27cae1331b808aa7423e86609c3cd1bbb3d" exitCode=0
Jul 10 23:03:35.057718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:35.057311    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k" event={"ID":"08805159-b168-43da-a87b-d703b467968c","Type":"ContainerDied","Data":"2149c988a6f3f281e33d9c6935d5a27cae1331b808aa7423e86609c3cd1bbb3d"}
Jul 10 23:03:42.088052 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:42.087953    2558 generic.go:356] "Generic (PLEG): container finished" podID="08805159-b168-43da-a87b-d703b467968c" containerID="69b438deb31599904e51c87880fec44c06941aa49a3cd33eb4e55e46f3d396fa" exitCode=0
Jul 10 23:03:42.088430 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:42.088043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k" event={"ID":"08805159-b168-43da-a87b-d703b467968c","Type":"ContainerDied","Data":"69b438deb31599904e51c87880fec44c06941aa49a3cd33eb4e55e46f3d396fa"}
Jul 10 23:03:43.213136 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.213115    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:43.243870 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.243838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6c9f\" (UniqueName: \"kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f\") pod \"08805159-b168-43da-a87b-d703b467968c\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") "
Jul 10 23:03:43.244045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.243890    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle\") pod \"08805159-b168-43da-a87b-d703b467968c\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") "
Jul 10 23:03:43.244045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.243924    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util\") pod \"08805159-b168-43da-a87b-d703b467968c\" (UID: \"08805159-b168-43da-a87b-d703b467968c\") "
Jul 10 23:03:43.244276 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.244253    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle" (OuterVolumeSpecName: "bundle") pod "08805159-b168-43da-a87b-d703b467968c" (UID: "08805159-b168-43da-a87b-d703b467968c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:03:43.246317 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.246286    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f" (OuterVolumeSpecName: "kube-api-access-b6c9f") pod "08805159-b168-43da-a87b-d703b467968c" (UID: "08805159-b168-43da-a87b-d703b467968c"). InnerVolumeSpecName "kube-api-access-b6c9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:03:43.248025 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.248004    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util" (OuterVolumeSpecName: "util") pod "08805159-b168-43da-a87b-d703b467968c" (UID: "08805159-b168-43da-a87b-d703b467968c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:03:43.344994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.344911    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:03:43.344994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.344936    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08805159-b168-43da-a87b-d703b467968c-util\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:03:43.344994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:43.344945    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6c9f\" (UniqueName: \"kubernetes.io/projected/08805159-b168-43da-a87b-d703b467968c-kube-api-access-b6c9f\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:03:44.095962 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:44.095929    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k"
Jul 10 23:03:44.096142 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:44.095934    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fttx4k" event={"ID":"08805159-b168-43da-a87b-d703b467968c","Type":"ContainerDied","Data":"b5c9918a6a6a28aa2e6ab521ab9e4e5880563a13a62c218dea5bd3f1e073b9ab"}
Jul 10 23:03:44.096142 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:03:44.096053    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5c9918a6a6a28aa2e6ab521ab9e4e5880563a13a62c218dea5bd3f1e073b9ab"
Jul 10 23:04:09.177674 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177642    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"]
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177893    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="util"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177904    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="util"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177911    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="extract"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177916    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="extract"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177930    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="pull"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177939    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="pull"
Jul 10 23:04:09.178141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.177993    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="08805159-b168-43da-a87b-d703b467968c" containerName="extract"
Jul 10 23:04:09.182162 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.182139    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.184836 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.184812    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 23:04:09.184985 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.184963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 23:04:09.185055 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.184989    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 23:04:09.185055 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.185041    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-94qk9\""
Jul 10 23:04:09.189381 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.189359    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 23:04:09.207174 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.207140    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"]
Jul 10 23:04:09.232859 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.232823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.233048 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.232899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.233048 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.232923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.233048 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.232957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.233162 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.233068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg6d4\" (UniqueName: \"kubernetes.io/projected/32772ee7-e155-4495-9cbd-9a746cfa88be-kube-api-access-pg6d4\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333420 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg6d4\" (UniqueName: \"kubernetes.io/projected/32772ee7-e155-4495-9cbd-9a746cfa88be-kube-api-access-pg6d4\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333545    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.333953 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.333931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-manifests\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.335975 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.335954    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32772ee7-e155-4495-9cbd-9a746cfa88be-tmp\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.336095 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.336076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-webhook-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.336183 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.336165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/32772ee7-e155-4495-9cbd-9a746cfa88be-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.342787 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.342758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg6d4\" (UniqueName: \"kubernetes.io/projected/32772ee7-e155-4495-9cbd-9a746cfa88be-kube-api-access-pg6d4\") pod \"opendatahub-operator-controller-manager-58bf55498c-gqhvw\" (UID: \"32772ee7-e155-4495-9cbd-9a746cfa88be\") " pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.492729 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.492637    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:09.627061 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:09.627024    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"]
Jul 10 23:04:09.630339 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:09.630316    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32772ee7_e155_4495_9cbd_9a746cfa88be.slice/crio-f28829f088ab5b72bcbf66b4bc71e89d4d207578855934a53777cb19cbda2e7b WatchSource:0}: Error finding container f28829f088ab5b72bcbf66b4bc71e89d4d207578855934a53777cb19cbda2e7b: Status 404 returned error can't find the container with id f28829f088ab5b72bcbf66b4bc71e89d4d207578855934a53777cb19cbda2e7b
Jul 10 23:04:10.188997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:10.188956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw" event={"ID":"32772ee7-e155-4495-9cbd-9a746cfa88be","Type":"ContainerStarted","Data":"f28829f088ab5b72bcbf66b4bc71e89d4d207578855934a53777cb19cbda2e7b"}
Jul 10 23:04:13.207679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:13.207639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw" event={"ID":"32772ee7-e155-4495-9cbd-9a746cfa88be","Type":"ContainerStarted","Data":"558a033ce13f6488af0df8d58fe713eac285a2171eefec4ac12b5590b3cd12d3"}
Jul 10 23:04:14.212718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:14.212690    2558 generic.go:356] "Generic (PLEG): container finished" podID="32772ee7-e155-4495-9cbd-9a746cfa88be" containerID="558a033ce13f6488af0df8d58fe713eac285a2171eefec4ac12b5590b3cd12d3" exitCode=0
Jul 10 23:04:14.213113 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:14.212754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw" event={"ID":"32772ee7-e155-4495-9cbd-9a746cfa88be","Type":"ContainerDied","Data":"558a033ce13f6488af0df8d58fe713eac285a2171eefec4ac12b5590b3cd12d3"}
Jul 10 23:04:15.218955 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:15.218915    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw" event={"ID":"32772ee7-e155-4495-9cbd-9a746cfa88be","Type":"ContainerStarted","Data":"b5310b2220ed2ade963439a62a1ecc5ceaab4913c0abeacd3899b786f6d80363"}
Jul 10 23:04:15.219413 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:15.219052    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:15.240014 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:15.239962    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw" podStartSLOduration=1.886208897 podStartE2EDuration="6.239947476s" totalImagesPullingTime="3.325649195s" totalInitContainerRuntime="1.028089384s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:15.238038418 +0000 UTC m=+501.213593420" watchObservedRunningTime="2026-07-10 23:04:15.239947476 +0000 UTC m=+501.215502517"
Jul 10 23:04:26.225833 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:26.225796    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58bf55498c-gqhvw"
Jul 10 23:04:28.981760 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.981723    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"]
Jul 10 23:04:28.988801 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.988781    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:28.992334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.992309    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 23:04:28.992432 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.992312    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vg7gz\""
Jul 10 23:04:28.992525 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.992489    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 23:04:28.992703 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.992689    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 23:04:28.993188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:28.993175    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 23:04:29.003024 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.003003    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"]
Jul 10 23:04:29.089036 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.089006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831a6973-f36c-424f-be85-d3bfa988869e-tmp\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.089036 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.089040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831a6973-f36c-424f-be85-d3bfa988869e-tls-certs\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.089248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.089078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4lq\" (UniqueName: \"kubernetes.io/projected/831a6973-f36c-424f-be85-d3bfa988869e-kube-api-access-wc4lq\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.189413 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.189381    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831a6973-f36c-424f-be85-d3bfa988869e-tmp\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.189413 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.189418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831a6973-f36c-424f-be85-d3bfa988869e-tls-certs\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.189696 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.189456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4lq\" (UniqueName: \"kubernetes.io/projected/831a6973-f36c-424f-be85-d3bfa988869e-kube-api-access-wc4lq\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.192063 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.192039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/831a6973-f36c-424f-be85-d3bfa988869e-tmp\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.192184 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.192173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/831a6973-f36c-424f-be85-d3bfa988869e-tls-certs\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.193021 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.193003    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g8ctf"]
Jul 10 23:04:29.196062 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.196048    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.198685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.198645    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 10 23:04:29.198792 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.198695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lczlz\""
Jul 10 23:04:29.208461 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.208442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4lq\" (UniqueName: \"kubernetes.io/projected/831a6973-f36c-424f-be85-d3bfa988869e-kube-api-access-wc4lq\") pod \"kube-auth-proxy-7947c57c45-77dnm\" (UID: \"831a6973-f36c-424f-be85-d3bfa988869e\") " pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.213843 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.213810    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g8ctf"]
Jul 10 23:04:29.290804 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.290724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.290804 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.290761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpfkg\" (UniqueName: \"kubernetes.io/projected/88df527e-e2a7-4f82-a846-f75ac7c9ed21-kube-api-access-hpfkg\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.297663 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.297644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"
Jul 10 23:04:29.392020 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.391992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.392159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.392029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpfkg\" (UniqueName: \"kubernetes.io/projected/88df527e-e2a7-4f82-a846-f75ac7c9ed21-kube-api-access-hpfkg\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.392210 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:04:29.392153    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 10 23:04:29.392303 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:04:29.392217    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert podName:88df527e-e2a7-4f82-a846-f75ac7c9ed21 nodeName:}" failed. No retries permitted until 2026-07-10 23:04:29.892196552 +0000 UTC m=+515.867751532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert") pod "odh-model-controller-7998c67dc4-g8ctf" (UID: "88df527e-e2a7-4f82-a846-f75ac7c9ed21") : secret "odh-model-controller-webhook-cert" not found
Jul 10 23:04:29.400650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.400622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpfkg\" (UniqueName: \"kubernetes.io/projected/88df527e-e2a7-4f82-a846-f75ac7c9ed21-kube-api-access-hpfkg\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.443583 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.443560    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7947c57c45-77dnm"]
Jul 10 23:04:29.445880 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:29.445857    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831a6973_f36c_424f_be85_d3bfa988869e.slice/crio-7777993077e75275a527cb0884a1faee932374dff75dd131f1fb62cc4f100c5c WatchSource:0}: Error finding container 7777993077e75275a527cb0884a1faee932374dff75dd131f1fb62cc4f100c5c: Status 404 returned error can't find the container with id 7777993077e75275a527cb0884a1faee932374dff75dd131f1fb62cc4f100c5c
Jul 10 23:04:29.896166 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.896109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:29.898676 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:29.898649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/88df527e-e2a7-4f82-a846-f75ac7c9ed21-cert\") pod \"odh-model-controller-7998c67dc4-g8ctf\" (UID: \"88df527e-e2a7-4f82-a846-f75ac7c9ed21\") " pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:30.116770 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.116734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:30.137106 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.137078    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltssw"]
Jul 10 23:04:30.140309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.140291    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.144636 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.144614    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 10 23:04:30.161401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.161370    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltssw"]
Jul 10 23:04:30.201150 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.201039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21f4a97f-0520-42f2-9222-11870c30ef78-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.201367 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.201150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g48x\" (UniqueName: \"kubernetes.io/projected/21f4a97f-0520-42f2-9222-11870c30ef78-kube-api-access-8g48x\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.248596 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.248566    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g8ctf"]
Jul 10 23:04:30.251310 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:30.251288    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88df527e_e2a7_4f82_a846_f75ac7c9ed21.slice/crio-b4ed1ddc2e89819a4f41f58b19812da4ceb9fb05781ecfdd0a9b208f7b4b41ca WatchSource:0}: Error finding container b4ed1ddc2e89819a4f41f58b19812da4ceb9fb05781ecfdd0a9b208f7b4b41ca: Status 404 returned error can't find the container with id b4ed1ddc2e89819a4f41f58b19812da4ceb9fb05781ecfdd0a9b208f7b4b41ca
Jul 10 23:04:30.274378 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.274343    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf" event={"ID":"88df527e-e2a7-4f82-a846-f75ac7c9ed21","Type":"ContainerStarted","Data":"b4ed1ddc2e89819a4f41f58b19812da4ceb9fb05781ecfdd0a9b208f7b4b41ca"}
Jul 10 23:04:30.275767 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.275746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm" event={"ID":"831a6973-f36c-424f-be85-d3bfa988869e","Type":"ContainerStarted","Data":"7777993077e75275a527cb0884a1faee932374dff75dd131f1fb62cc4f100c5c"}
Jul 10 23:04:30.302306 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.302273    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21f4a97f-0520-42f2-9222-11870c30ef78-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.302443 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.302321    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g48x\" (UniqueName: \"kubernetes.io/projected/21f4a97f-0520-42f2-9222-11870c30ef78-kube-api-access-8g48x\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.305222 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.305192    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21f4a97f-0520-42f2-9222-11870c30ef78-tls-certs\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.316150 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.316130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g48x\" (UniqueName: \"kubernetes.io/projected/21f4a97f-0520-42f2-9222-11870c30ef78-kube-api-access-8g48x\") pod \"model-serving-api-54d89bd5fc-ltssw\" (UID: \"21f4a97f-0520-42f2-9222-11870c30ef78\") " pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.392402 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.392369    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:30.395779 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.395762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.397939 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.397888    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 23:04:30.398073 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.398060    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 23:04:30.398254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.398244    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-blj7j\""
Jul 10 23:04:30.398254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.398245    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 23:04:30.398388 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.398345    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 23:04:30.408294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.408272    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:30.450640 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.450611    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:30.503752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.503752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.503989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.503989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.503989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq7pq\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.503989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.503971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.504214 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.504035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.598327 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.598289    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ltssw"]
Jul 10 23:04:30.600749 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:30.600715    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f4a97f_0520_42f2_9222_11870c30ef78.slice/crio-9dc9b80f7aad7ed3cd04d73a3babccdcc8f9edb101e599736d95f5c6622fa587 WatchSource:0}: Error finding container 9dc9b80f7aad7ed3cd04d73a3babccdcc8f9edb101e599736d95f5c6622fa587: Status 404 returned error can't find the container with id 9dc9b80f7aad7ed3cd04d73a3babccdcc8f9edb101e599736d95f5c6622fa587
Jul 10 23:04:30.604903 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.604816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.604903 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.604881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.604906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.604939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.604962    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.605006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq7pq\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605210 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.605046    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.605950 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.605922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.607613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.607589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.607915 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.607871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.608011 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.607940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.608744 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.608723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.612656 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.612637    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.613336 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.613314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq7pq\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq\") pod \"istiod-openshift-gateway-7574459656-l6vsx\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.705750 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.705673    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:30.842876 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:30.842736    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:30.845344 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:30.845315    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f82ec6_fecd_4412_9252_1b61b28d3ec9.slice/crio-f5aca5c72c0d603030c3070798012c46a835d11392c368088713ee6c6f658357 WatchSource:0}: Error finding container f5aca5c72c0d603030c3070798012c46a835d11392c368088713ee6c6f658357: Status 404 returned error can't find the container with id f5aca5c72c0d603030c3070798012c46a835d11392c368088713ee6c6f658357
Jul 10 23:04:31.297845 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:31.297802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw" event={"ID":"21f4a97f-0520-42f2-9222-11870c30ef78","Type":"ContainerStarted","Data":"9dc9b80f7aad7ed3cd04d73a3babccdcc8f9edb101e599736d95f5c6622fa587"}
Jul 10 23:04:31.300356 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:31.300322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" event={"ID":"35f82ec6-fecd-4412-9252-1b61b28d3ec9","Type":"ContainerStarted","Data":"f5aca5c72c0d603030c3070798012c46a835d11392c368088713ee6c6f658357"}
Jul 10 23:04:35.468337 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:35.468298    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:04:35.468723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:35.468367    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:04:36.327525 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.327469    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm" event={"ID":"831a6973-f36c-424f-be85-d3bfa988869e","Type":"ContainerStarted","Data":"6ac057de9539afa2634214acf75321c5f0f947cd755cf20ce265b9622c293190"}
Jul 10 23:04:36.329322 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.329287    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw" event={"ID":"21f4a97f-0520-42f2-9222-11870c30ef78","Type":"ContainerStarted","Data":"0d2e282d25f48065bce3d2affde4661f6e5ec6982cb0f19092cd2fd5d684a8a3"}
Jul 10 23:04:36.329490 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.329390    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:04:36.330950 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.330924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf" event={"ID":"88df527e-e2a7-4f82-a846-f75ac7c9ed21","Type":"ContainerStarted","Data":"75c4f488c964b40d6336df764b450dfe1f39ab694744ba2a50d00fa442bf057d"}
Jul 10 23:04:36.331088 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.331005    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:36.332450 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.332416    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" event={"ID":"35f82ec6-fecd-4412-9252-1b61b28d3ec9","Type":"ContainerStarted","Data":"e6038b099ff79ca482c00e192c8a2057407369c5a2c2c3361b223a54bbba5a71"}
Jul 10 23:04:36.332620 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.332605    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:36.334355 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.334335    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-l6vsx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 23:04:36.334446 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.334378    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 23:04:36.367875 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.367809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7947c57c45-77dnm" podStartSLOduration=2.349653087 podStartE2EDuration="8.367789744s" totalImagesPullingTime="6.018136657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:36.364906968 +0000 UTC m=+522.340461969" watchObservedRunningTime="2026-07-10 23:04:36.367789744 +0000 UTC m=+522.343344746"
Jul 10 23:04:36.417003 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.416951    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf" podStartSLOduration=2.193963142 podStartE2EDuration="7.416933144s" totalImagesPullingTime="5.222970002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:36.416357741 +0000 UTC m=+522.391912742" watchObservedRunningTime="2026-07-10 23:04:36.416933144 +0000 UTC m=+522.392488124"
Jul 10 23:04:36.464617 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.464570    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw" podStartSLOduration=1.601866539 podStartE2EDuration="6.464554388s" totalImagesPullingTime="4.862687849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:36.455373752 +0000 UTC m=+522.430928747" watchObservedRunningTime="2026-07-10 23:04:36.464554388 +0000 UTC m=+522.440109381"
Jul 10 23:04:36.498952 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.498897    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" podStartSLOduration=1.878172597 podStartE2EDuration="6.498877026s" totalImagesPullingTime="4.620704429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:36.49600641 +0000 UTC m=+522.471561411" watchObservedRunningTime="2026-07-10 23:04:36.498877026 +0000 UTC m=+522.474432044"
Jul 10 23:04:36.957638 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.957606    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"]
Jul 10 23:04:36.961056 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.961034    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:36.966189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.966168    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wc9dq\""
Jul 10 23:04:36.985015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:36.984981    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"]
Jul 10 23:04:37.066299 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tmn2\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-kube-api-access-7tmn2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066568 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066568 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066568 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066568 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066561    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066813 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066813 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066813 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.066813 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.066764    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167437 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167401    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167437 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167440    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167527    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167762 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tmn2\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-kube-api-access-7tmn2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167863 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167883    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167903    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167950    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.167988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.167968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.168229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.168158    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.168229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.168178    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.168660 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.168640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.170175 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.170156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.170224 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.170164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.178834 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.178806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.179212 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.179186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tmn2\" (UniqueName: \"kubernetes.io/projected/ba5a5ff4-700d-4b7d-9e92-d8e4f819c687-kube-api-access-7tmn2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nkzkw\" (UID: \"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.271368 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.271277    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:37.338936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.338841    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:37.431650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:37.431613    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"]
Jul 10 23:04:37.433736 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:37.433711    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5a5ff4_700d_4b7d_9e92_d8e4f819c687.slice/crio-a9ab4b0e18c802a00f1f38e5f56bfe3c98f8f0164a1a0e3fe3c583d82d716f10 WatchSource:0}: Error finding container a9ab4b0e18c802a00f1f38e5f56bfe3c98f8f0164a1a0e3fe3c583d82d716f10: Status 404 returned error can't find the container with id a9ab4b0e18c802a00f1f38e5f56bfe3c98f8f0164a1a0e3fe3c583d82d716f10
Jul 10 23:04:38.344866 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:38.344798    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw" event={"ID":"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687","Type":"ContainerStarted","Data":"a9ab4b0e18c802a00f1f38e5f56bfe3c98f8f0164a1a0e3fe3c583d82d716f10"}
Jul 10 23:04:39.250743 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.250710    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"]
Jul 10 23:04:39.257078 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.257056    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.259490 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.259470    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 10 23:04:39.259635 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.259562    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5gfnm\""
Jul 10 23:04:39.264454 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.264430    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"]
Jul 10 23:04:39.269754 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.269636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"]
Jul 10 23:04:39.269754 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.269745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.273466 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.272143    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7gwl7\""
Jul 10 23:04:39.273466 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.273072    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 23:04:39.283338 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.283308    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"]
Jul 10 23:04:39.393471 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.393442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.393899 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.393494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pt7q\" (UniqueName: \"kubernetes.io/projected/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-kube-api-access-5pt7q\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.393899 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.393588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x74cx\" (UniqueName: \"kubernetes.io/projected/074262a2-d77a-4e42-90f3-9082b3cf94c0-kube-api-access-x74cx\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.393899 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.393662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-cert\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.494763 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.494724    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-cert\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.494931 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.494826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.494931 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.494867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pt7q\" (UniqueName: \"kubernetes.io/projected/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-kube-api-access-5pt7q\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.494931 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.494904    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x74cx\" (UniqueName: \"kubernetes.io/projected/074262a2-d77a-4e42-90f3-9082b3cf94c0-kube-api-access-x74cx\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.495090 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:04:39.494934    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 23:04:39.495090 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:04:39.495013    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert podName:074262a2-d77a-4e42-90f3-9082b3cf94c0 nodeName:}" failed. No retries permitted until 2026-07-10 23:04:39.99499019 +0000 UTC m=+525.970545193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert") pod "llmisvc-controller-manager-777c6bd7d5-gvpxv" (UID: "074262a2-d77a-4e42-90f3-9082b3cf94c0") : secret "llmisvc-webhook-server-cert" not found
Jul 10 23:04:39.497718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.497691    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-cert\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.508542 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.508437    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pt7q\" (UniqueName: \"kubernetes.io/projected/a7d53e3a-bfd2-4033-9c95-64caa9ddb165-kube-api-access-5pt7q\") pod \"kserve-controller-manager-d6f4b65b8-vtr5t\" (UID: \"a7d53e3a-bfd2-4033-9c95-64caa9ddb165\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:39.508700 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.508674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x74cx\" (UniqueName: \"kubernetes.io/projected/074262a2-d77a-4e42-90f3-9082b3cf94c0-kube-api-access-x74cx\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:39.570755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:39.570718    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:40.000327 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.000285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:40.003188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.003151    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/074262a2-d77a-4e42-90f3-9082b3cf94c0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gvpxv\" (UID: \"074262a2-d77a-4e42-90f3-9082b3cf94c0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:40.182319 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.182285    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:40.197730 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.197691    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:04:40.197856 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.197784    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:04:40.197856 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.197829    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:04:40.269560 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.269530    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"]
Jul 10 23:04:40.272885 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:40.272851    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d53e3a_bfd2_4033_9c95_64caa9ddb165.slice/crio-2e013248d1cfa4874a127692e23a9d7b201899e2d2438a7e50f855ab1b2519d4 WatchSource:0}: Error finding container 2e013248d1cfa4874a127692e23a9d7b201899e2d2438a7e50f855ab1b2519d4: Status 404 returned error can't find the container with id 2e013248d1cfa4874a127692e23a9d7b201899e2d2438a7e50f855ab1b2519d4
Jul 10 23:04:40.338169 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.338143    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"]
Jul 10 23:04:40.340806 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:04:40.340781    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod074262a2_d77a_4e42_90f3_9082b3cf94c0.slice/crio-9d107709c832ecbf6beda6ea906127762fe2b6311bb92966fae37ff7c4b66047 WatchSource:0}: Error finding container 9d107709c832ecbf6beda6ea906127762fe2b6311bb92966fae37ff7c4b66047: Status 404 returned error can't find the container with id 9d107709c832ecbf6beda6ea906127762fe2b6311bb92966fae37ff7c4b66047
Jul 10 23:04:40.362591 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.362553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv" event={"ID":"074262a2-d77a-4e42-90f3-9082b3cf94c0","Type":"ContainerStarted","Data":"9d107709c832ecbf6beda6ea906127762fe2b6311bb92966fae37ff7c4b66047"}
Jul 10 23:04:40.364233 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.364203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw" event={"ID":"ba5a5ff4-700d-4b7d-9e92-d8e4f819c687","Type":"ContainerStarted","Data":"800efa0fa521e7f1147b6a3e28293270ceff817b8b747964fe367194b44c1a88"}
Jul 10 23:04:40.365449 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.365429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t" event={"ID":"a7d53e3a-bfd2-4033-9c95-64caa9ddb165","Type":"ContainerStarted","Data":"2e013248d1cfa4874a127692e23a9d7b201899e2d2438a7e50f855ab1b2519d4"}
Jul 10 23:04:40.414031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:40.413981    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw" podStartSLOduration=1.652564645 podStartE2EDuration="4.413964804s" totalImagesPullingTime="2.761400159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:40.411257118 +0000 UTC m=+526.386812120" watchObservedRunningTime="2026-07-10 23:04:40.413964804 +0000 UTC m=+526.389519805"
Jul 10 23:04:41.099347 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.099312    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:41.099618 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.099588    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerName="discovery" containerID="cri-o://e6038b099ff79ca482c00e192c8a2057407369c5a2c2c3361b223a54bbba5a71" gracePeriod=30
Jul 10 23:04:41.272128 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.271865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:41.277977 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.277915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:41.375170 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.375085    2558 generic.go:356] "Generic (PLEG): container finished" podID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerID="e6038b099ff79ca482c00e192c8a2057407369c5a2c2c3361b223a54bbba5a71" exitCode=0
Jul 10 23:04:41.375329 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.375206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" event={"ID":"35f82ec6-fecd-4412-9252-1b61b28d3ec9","Type":"ContainerDied","Data":"e6038b099ff79ca482c00e192c8a2057407369c5a2c2c3361b223a54bbba5a71"}
Jul 10 23:04:41.375762 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.375515    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:41.377085 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.376863    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nkzkw"
Jul 10 23:04:41.623116 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.623079    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:41.819169 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819137    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819184    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819216    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819248    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq7pq\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819281    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819333    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.819636 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819381    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap\") pod \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\" (UID: \"35f82ec6-fecd-4412-9252-1b61b28d3ec9\") "
Jul 10 23:04:41.820188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.819922    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:04:41.824652 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.824601    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token" (OuterVolumeSpecName: "istio-token") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:04:41.824855 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.824714    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs" (OuterVolumeSpecName: "local-certs") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:04:41.824855 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.824840    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq" (OuterVolumeSpecName: "kube-api-access-mq7pq") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "kube-api-access-mq7pq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:04:41.825201 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.824940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts" (OuterVolumeSpecName: "cacerts") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:04:41.825561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.825534    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:04:41.826766 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.826731    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "35f82ec6-fecd-4412-9252-1b61b28d3ec9" (UID: "35f82ec6-fecd-4412-9252-1b61b28d3ec9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:04:41.920295 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920261    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-ca-configmap\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920295 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920290    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-cacerts\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920295 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920301    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-kubeconfig\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920310    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-token\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920320    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq7pq\" (UniqueName: \"kubernetes.io/projected/35f82ec6-fecd-4412-9252-1b61b28d3ec9-kube-api-access-mq7pq\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920329    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/35f82ec6-fecd-4412-9252-1b61b28d3ec9-local-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:41.920585 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:41.920339    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/35f82ec6-fecd-4412-9252-1b61b28d3ec9-istio-csr-dns-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:04:42.382516 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.382430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx" event={"ID":"35f82ec6-fecd-4412-9252-1b61b28d3ec9","Type":"ContainerDied","Data":"f5aca5c72c0d603030c3070798012c46a835d11392c368088713ee6c6f658357"}
Jul 10 23:04:42.382516 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.382464    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"
Jul 10 23:04:42.382516 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.382519    2558 scope.go:117] "RemoveContainer" containerID="e6038b099ff79ca482c00e192c8a2057407369c5a2c2c3361b223a54bbba5a71"
Jul 10 23:04:42.407380 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.407343    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:42.411237 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.411211    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-l6vsx"]
Jul 10 23:04:42.542477 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:42.542129    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" path="/var/lib/kubelet/pods/35f82ec6-fecd-4412-9252-1b61b28d3ec9/volumes"
Jul 10 23:04:43.388672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.388642    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t" event={"ID":"a7d53e3a-bfd2-4033-9c95-64caa9ddb165","Type":"ContainerStarted","Data":"09fa8b855c9aba2d76bdef4596a8d4667c5ce06cd81eeca4a0c525c16d5dc670"}
Jul 10 23:04:43.389060 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.388705    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:04:43.390316 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.390292    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv" event={"ID":"074262a2-d77a-4e42-90f3-9082b3cf94c0","Type":"ContainerStarted","Data":"a3e123a7e164f1342136830fa50a37afa596c265604e6579af496cc0b734d4c1"}
Jul 10 23:04:43.390459 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.390368    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:04:43.408199 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.408151    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t" podStartSLOduration=1.394938085 podStartE2EDuration="4.408134983s" totalImagesPullingTime="3.013196898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:43.407213482 +0000 UTC m=+529.382768483" watchObservedRunningTime="2026-07-10 23:04:43.408134983 +0000 UTC m=+529.383689979"
Jul 10 23:04:43.422851 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:43.422809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv" podStartSLOduration=1.47283278 podStartE2EDuration="4.422795361s" totalImagesPullingTime="2.949962581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:04:43.421653663 +0000 UTC m=+529.397208666" watchObservedRunningTime="2026-07-10 23:04:43.422795361 +0000 UTC m=+529.398350363"
Jul 10 23:04:47.341001 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:47.340913    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-g8ctf"
Jul 10 23:04:47.342233 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:04:47.342214    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ltssw"
Jul 10 23:05:14.397967 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:14.397936    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gvpxv"
Jul 10 23:05:14.401087 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:14.401063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-vtr5t"
Jul 10 23:05:29.969851 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.969820    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:29.970294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.970115    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerName="discovery"
Jul 10 23:05:29.970294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.970125    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerName="discovery"
Jul 10 23:05:29.970294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.970176    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="35f82ec6-fecd-4412-9252-1b61b28d3ec9" containerName="discovery"
Jul 10 23:05:29.973206 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.973191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:29.975751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.975422    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-4f2rd\""
Jul 10 23:05:29.975751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.975478    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 23:05:29.975751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.975527    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 23:05:29.983153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:29.983132    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:30.030039 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.029999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnmx7\" (UniqueName: \"kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7\") pod \"kuadrant-operator-catalog-mbjbn\" (UID: \"c3338068-36a3-44a0-8cd0-116b8d3be291\") " pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:30.130869 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.130830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmx7\" (UniqueName: \"kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7\") pod \"kuadrant-operator-catalog-mbjbn\" (UID: \"c3338068-36a3-44a0-8cd0-116b8d3be291\") " pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:30.139005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.138972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmx7\" (UniqueName: \"kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7\") pod \"kuadrant-operator-catalog-mbjbn\" (UID: \"c3338068-36a3-44a0-8cd0-116b8d3be291\") " pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:30.285291 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.285212    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:30.350717 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.350688    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:30.418626 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.418599    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:30.421633 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:30.421606    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3338068_36a3_44a0_8cd0_116b8d3be291.slice/crio-593eb8973599bbcf6f07483597941e2cd231d1752f5ffbc2a2f2e01e69984194 WatchSource:0}: Error finding container 593eb8973599bbcf6f07483597941e2cd231d1752f5ffbc2a2f2e01e69984194: Status 404 returned error can't find the container with id 593eb8973599bbcf6f07483597941e2cd231d1752f5ffbc2a2f2e01e69984194
Jul 10 23:05:30.550621 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.550549    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qdd"]
Jul 10 23:05:30.553328 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.553312    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:30.560862 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.560838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qdd"]
Jul 10 23:05:30.580983 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.580957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" event={"ID":"c3338068-36a3-44a0-8cd0-116b8d3be291","Type":"ContainerStarted","Data":"593eb8973599bbcf6f07483597941e2cd231d1752f5ffbc2a2f2e01e69984194"}
Jul 10 23:05:30.633458 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.633426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmw4h\" (UniqueName: \"kubernetes.io/projected/c0c007f7-123d-43ec-ac8f-d6fb8a5a630b-kube-api-access-gmw4h\") pod \"kuadrant-operator-catalog-p9qdd\" (UID: \"c0c007f7-123d-43ec-ac8f-d6fb8a5a630b\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:30.734289 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.734255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmw4h\" (UniqueName: \"kubernetes.io/projected/c0c007f7-123d-43ec-ac8f-d6fb8a5a630b-kube-api-access-gmw4h\") pod \"kuadrant-operator-catalog-p9qdd\" (UID: \"c0c007f7-123d-43ec-ac8f-d6fb8a5a630b\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:30.742878 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.742850    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmw4h\" (UniqueName: \"kubernetes.io/projected/c0c007f7-123d-43ec-ac8f-d6fb8a5a630b-kube-api-access-gmw4h\") pod \"kuadrant-operator-catalog-p9qdd\" (UID: \"c0c007f7-123d-43ec-ac8f-d6fb8a5a630b\") " pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:30.862678 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:30.862599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:31.006723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:31.006688    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p9qdd"]
Jul 10 23:05:31.049907 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:31.049876    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c007f7_123d_43ec_ac8f_d6fb8a5a630b.slice/crio-f3b162ca9a36d3fca1d0f6cd94ccb41cf6ce65c4935249d770f13ce21cb63501 WatchSource:0}: Error finding container f3b162ca9a36d3fca1d0f6cd94ccb41cf6ce65c4935249d770f13ce21cb63501: Status 404 returned error can't find the container with id f3b162ca9a36d3fca1d0f6cd94ccb41cf6ce65c4935249d770f13ce21cb63501
Jul 10 23:05:31.590407 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:31.590368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd" event={"ID":"c0c007f7-123d-43ec-ac8f-d6fb8a5a630b","Type":"ContainerStarted","Data":"f3b162ca9a36d3fca1d0f6cd94ccb41cf6ce65c4935249d770f13ce21cb63501"}
Jul 10 23:05:32.596951 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.596896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd" event={"ID":"c0c007f7-123d-43ec-ac8f-d6fb8a5a630b","Type":"ContainerStarted","Data":"753bb61ef7d5042f76b287548506f2ca592a9bc7f57e36ed548f089dfa30f509"}
Jul 10 23:05:32.598657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.598624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" event={"ID":"c3338068-36a3-44a0-8cd0-116b8d3be291","Type":"ContainerStarted","Data":"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"}
Jul 10 23:05:32.598799 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.598737    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" podUID="c3338068-36a3-44a0-8cd0-116b8d3be291" containerName="registry-server" containerID="cri-o://bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519" gracePeriod=2
Jul 10 23:05:32.614264 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.614197    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd" podStartSLOduration=1.272104458 podStartE2EDuration="2.614172786s" totalImagesPullingTime="1.342068328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:05:32.612659273 +0000 UTC m=+578.588214278" watchObservedRunningTime="2026-07-10 23:05:32.614172786 +0000 UTC m=+578.589727789"
Jul 10 23:05:32.627744 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.627691    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" podStartSLOduration=1.657951235 podStartE2EDuration="3.627674255s" totalImagesPullingTime="1.96972302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:05:32.625715399 +0000 UTC m=+578.601270402" watchObservedRunningTime="2026-07-10 23:05:32.627674255 +0000 UTC m=+578.603229256"
Jul 10 23:05:32.859958 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.859929    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:32.953367 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.953328    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnmx7\" (UniqueName: \"kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7\") pod \"c3338068-36a3-44a0-8cd0-116b8d3be291\" (UID: \"c3338068-36a3-44a0-8cd0-116b8d3be291\") "
Jul 10 23:05:32.955755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:32.955730    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7" (OuterVolumeSpecName: "kube-api-access-qnmx7") pod "c3338068-36a3-44a0-8cd0-116b8d3be291" (UID: "c3338068-36a3-44a0-8cd0-116b8d3be291"). InnerVolumeSpecName "kube-api-access-qnmx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:05:33.054392 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.054302    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnmx7\" (UniqueName: \"kubernetes.io/projected/c3338068-36a3-44a0-8cd0-116b8d3be291-kube-api-access-qnmx7\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:33.604422 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.604382    2558 generic.go:356] "Generic (PLEG): container finished" podID="c3338068-36a3-44a0-8cd0-116b8d3be291" containerID="bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519" exitCode=0
Jul 10 23:05:33.604919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.604432    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn"
Jul 10 23:05:33.604919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.604471    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" event={"ID":"c3338068-36a3-44a0-8cd0-116b8d3be291","Type":"ContainerDied","Data":"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"}
Jul 10 23:05:33.604919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.604539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mbjbn" event={"ID":"c3338068-36a3-44a0-8cd0-116b8d3be291","Type":"ContainerDied","Data":"593eb8973599bbcf6f07483597941e2cd231d1752f5ffbc2a2f2e01e69984194"}
Jul 10 23:05:33.604919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.604562    2558 scope.go:117] "RemoveContainer" containerID="bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"
Jul 10 23:05:33.614186 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.614162    2558 scope.go:117] "RemoveContainer" containerID="bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"
Jul 10 23:05:33.614520 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:05:33.614479    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519\": container with ID starting with bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519 not found: ID does not exist" containerID="bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"
Jul 10 23:05:33.614573 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.614529    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519"} err="failed to get container status \"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519\": rpc error: code = NotFound desc = could not find container \"bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519\": container with ID starting with bf036e5ad83627d8d8d9dd70882a70ed9e42754b01a5bf6726fd529fff127519 not found: ID does not exist"
Jul 10 23:05:33.624496 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.624460    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:33.627864 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:33.627834    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mbjbn"]
Jul 10 23:05:34.540030 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:34.539991    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3338068-36a3-44a0-8cd0-116b8d3be291" path="/var/lib/kubelet/pods/c3338068-36a3-44a0-8cd0-116b8d3be291/volumes"
Jul 10 23:05:40.863686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:40.863649    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:40.864118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:40.863740    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:40.886262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:40.886228    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:41.660067 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:41.660041    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-p9qdd"
Jul 10 23:05:45.785288 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.785260    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"]
Jul 10 23:05:45.785685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.785557    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3338068-36a3-44a0-8cd0-116b8d3be291" containerName="registry-server"
Jul 10 23:05:45.785685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.785568    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3338068-36a3-44a0-8cd0-116b8d3be291" containerName="registry-server"
Jul 10 23:05:45.785685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.785637    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3338068-36a3-44a0-8cd0-116b8d3be291" containerName="registry-server"
Jul 10 23:05:45.789821 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.789805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.791899 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.791878    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6pg8v\""
Jul 10 23:05:45.796795 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.796752    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"]
Jul 10 23:05:45.860330 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.860296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.860493 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.860348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.860493 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.860441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5zxg\" (UniqueName: \"kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.961660 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.961626    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.961811 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.961685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5zxg\" (UniqueName: \"kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.961811 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.961716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.962017 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.961995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.962087 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.962070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:45.969663 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:45.969643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5zxg\" (UniqueName: \"kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:46.099930 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.099849    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:46.241719 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.241697    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"]
Jul 10 23:05:46.244075 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:46.244048    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda827cf33_763e_4632_9c32_9f118f65ba58.slice/crio-6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655 WatchSource:0}: Error finding container 6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655: Status 404 returned error can't find the container with id 6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655
Jul 10 23:05:46.387908 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.387878    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"]
Jul 10 23:05:46.391059 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.391044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.398406 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.398383    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"]
Jul 10 23:05:46.465940 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.465901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.465940 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.465940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.466157 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.466035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4t8j\" (UniqueName: \"kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.566715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.566676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.566715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.566715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.566924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.566783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4t8j\" (UniqueName: \"kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.567090 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.567070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.567130 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.567095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.574473 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.574448    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4t8j\" (UniqueName: \"kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.659387 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.659299    2558 generic.go:356] "Generic (PLEG): container finished" podID="a827cf33-763e-4632-9c32-9f118f65ba58" containerID="c414664719fe5fa0e494cabb0b92172da9d46f16563b6b7c2c9203668aa5afa0" exitCode=0
Jul 10 23:05:46.659387 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.659338    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8" event={"ID":"a827cf33-763e-4632-9c32-9f118f65ba58","Type":"ContainerDied","Data":"c414664719fe5fa0e494cabb0b92172da9d46f16563b6b7c2c9203668aa5afa0"}
Jul 10 23:05:46.659387 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.659373    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8" event={"ID":"a827cf33-763e-4632-9c32-9f118f65ba58","Type":"ContainerStarted","Data":"6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655"}
Jul 10 23:05:46.718640 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.718600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:46.786546 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.786480    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"]
Jul 10 23:05:46.791005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.790982    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.798544 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.798496    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"]
Jul 10 23:05:46.857080 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.857056    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"]
Jul 10 23:05:46.859135 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:46.859113    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958d9dd1_e48d_4778_98cb_bb0518a5b943.slice/crio-27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416 WatchSource:0}: Error finding container 27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416: Status 404 returned error can't find the container with id 27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416
Jul 10 23:05:46.869685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.869660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.869768 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.869694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.869808 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.869786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nr4\" (UniqueName: \"kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.971290 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.970898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nr4\" (UniqueName: \"kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.971290 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.970984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.971290 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.971024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.975408 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.971784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.975408 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.972191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:46.979357 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:46.979330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nr4\" (UniqueName: \"kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:47.101475 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.101433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:47.189928 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.189897    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"]
Jul 10 23:05:47.196394 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.196373    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.203943 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.203783    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"]
Jul 10 23:05:47.233859 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.233838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"]
Jul 10 23:05:47.236357 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:47.236330    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709dd745_71f6_44cc_ab18_d647a6d007b5.slice/crio-f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215 WatchSource:0}: Error finding container f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215: Status 404 returned error can't find the container with id f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215
Jul 10 23:05:47.272527 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.272475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6l6k\" (UniqueName: \"kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.272642 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.272546    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.272642 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.272607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.373647 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.373612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6l6k\" (UniqueName: \"kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.373836 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.373670    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.373836 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.373699    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.374021 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.374005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.374104 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.374079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.382357 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.382335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6l6k\" (UniqueName: \"kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.509653 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.509571    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:47.661895 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.661869    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"]
Jul 10 23:05:47.665516 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.665473    2558 generic.go:356] "Generic (PLEG): container finished" podID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerID="48d0100877d0a7db4def28f3d1b5549849316088a0f601e0f64219b41034aaf7" exitCode=0
Jul 10 23:05:47.665639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.665532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn" event={"ID":"709dd745-71f6-44cc-ab18-d647a6d007b5","Type":"ContainerDied","Data":"48d0100877d0a7db4def28f3d1b5549849316088a0f601e0f64219b41034aaf7"}
Jul 10 23:05:47.665639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.665577    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn" event={"ID":"709dd745-71f6-44cc-ab18-d647a6d007b5","Type":"ContainerStarted","Data":"f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215"}
Jul 10 23:05:47.667353 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.667332    2558 generic.go:356] "Generic (PLEG): container finished" podID="a827cf33-763e-4632-9c32-9f118f65ba58" containerID="6ad525aaf7881c31aa675599209ae6d34ddb50a160eb2f8b9165b1bb33ad322a" exitCode=0
Jul 10 23:05:47.667440 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.667410    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8" event={"ID":"a827cf33-763e-4632-9c32-9f118f65ba58","Type":"ContainerDied","Data":"6ad525aaf7881c31aa675599209ae6d34ddb50a160eb2f8b9165b1bb33ad322a"}
Jul 10 23:05:47.669079 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.669059    2558 generic.go:356] "Generic (PLEG): container finished" podID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerID="474ca4f6aa8c78cd6b9ea6916bf83ec06b3561e0f8f5e2d9aecc5d439af5b30e" exitCode=0
Jul 10 23:05:47.669171 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.669097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt" event={"ID":"958d9dd1-e48d-4778-98cb-bb0518a5b943","Type":"ContainerDied","Data":"474ca4f6aa8c78cd6b9ea6916bf83ec06b3561e0f8f5e2d9aecc5d439af5b30e"}
Jul 10 23:05:47.669171 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:47.669126    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt" event={"ID":"958d9dd1-e48d-4778-98cb-bb0518a5b943","Type":"ContainerStarted","Data":"27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416"}
Jul 10 23:05:47.671418 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:05:47.671381    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod821f1a6b_974e_48fa_bed3_0f3c5a440277.slice/crio-0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26 WatchSource:0}: Error finding container 0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26: Status 404 returned error can't find the container with id 0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26
Jul 10 23:05:48.676088 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.676056    2558 generic.go:356] "Generic (PLEG): container finished" podID="a827cf33-763e-4632-9c32-9f118f65ba58" containerID="a4c0fcedab424204004c9b7ff48909ed4a768c30b6f0e1ca4c33d40d7f877a4e" exitCode=0
Jul 10 23:05:48.676513 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.676144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8" event={"ID":"a827cf33-763e-4632-9c32-9f118f65ba58","Type":"ContainerDied","Data":"a4c0fcedab424204004c9b7ff48909ed4a768c30b6f0e1ca4c33d40d7f877a4e"}
Jul 10 23:05:48.677888 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.677867    2558 generic.go:356] "Generic (PLEG): container finished" podID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerID="47e7667713082fbace50dd86eb026ad0226a51ba906cefa2dcdaaae2fce2651c" exitCode=0
Jul 10 23:05:48.677993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.677929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn" event={"ID":"709dd745-71f6-44cc-ab18-d647a6d007b5","Type":"ContainerDied","Data":"47e7667713082fbace50dd86eb026ad0226a51ba906cefa2dcdaaae2fce2651c"}
Jul 10 23:05:48.679366 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.679339    2558 generic.go:356] "Generic (PLEG): container finished" podID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerID="e54a97ef74210bbecd2c2c0d32f856ba2be7fc6944a4725f91d1d81bc911d3cc" exitCode=0
Jul 10 23:05:48.679456 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.679378    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p" event={"ID":"821f1a6b-974e-48fa-bed3-0f3c5a440277","Type":"ContainerDied","Data":"e54a97ef74210bbecd2c2c0d32f856ba2be7fc6944a4725f91d1d81bc911d3cc"}
Jul 10 23:05:48.679456 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:48.679412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p" event={"ID":"821f1a6b-974e-48fa-bed3-0f3c5a440277","Type":"ContainerStarted","Data":"0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26"}
Jul 10 23:05:49.686917 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.686878    2558 generic.go:356] "Generic (PLEG): container finished" podID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerID="4f49184761aa093495e9692846c3a6aa2184fded2a5db3abc581220ae81111ea" exitCode=0
Jul 10 23:05:49.687360 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.686961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn" event={"ID":"709dd745-71f6-44cc-ab18-d647a6d007b5","Type":"ContainerDied","Data":"4f49184761aa093495e9692846c3a6aa2184fded2a5db3abc581220ae81111ea"}
Jul 10 23:05:49.688762 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.688741    2558 generic.go:356] "Generic (PLEG): container finished" podID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerID="b08271e9bc4ad644d9183a7a03c7a8cc89f79b7a4df89e7f0c0037bc3508d389" exitCode=0
Jul 10 23:05:49.688872 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.688831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p" event={"ID":"821f1a6b-974e-48fa-bed3-0f3c5a440277","Type":"ContainerDied","Data":"b08271e9bc4ad644d9183a7a03c7a8cc89f79b7a4df89e7f0c0037bc3508d389"}
Jul 10 23:05:49.690845 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.690824    2558 generic.go:356] "Generic (PLEG): container finished" podID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerID="3214115a234121be242957566b1f5582037bd80434449fb1d1bfef1f6011a9cc" exitCode=0
Jul 10 23:05:49.690934 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.690883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt" event={"ID":"958d9dd1-e48d-4778-98cb-bb0518a5b943","Type":"ContainerDied","Data":"3214115a234121be242957566b1f5582037bd80434449fb1d1bfef1f6011a9cc"}
Jul 10 23:05:49.842575 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.842548    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:49.897337 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.897310    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util\") pod \"a827cf33-763e-4632-9c32-9f118f65ba58\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") "
Jul 10 23:05:49.897436 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.897369    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle\") pod \"a827cf33-763e-4632-9c32-9f118f65ba58\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") "
Jul 10 23:05:49.897436 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.897394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5zxg\" (UniqueName: \"kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg\") pod \"a827cf33-763e-4632-9c32-9f118f65ba58\" (UID: \"a827cf33-763e-4632-9c32-9f118f65ba58\") "
Jul 10 23:05:49.897844 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.897820    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle" (OuterVolumeSpecName: "bundle") pod "a827cf33-763e-4632-9c32-9f118f65ba58" (UID: "a827cf33-763e-4632-9c32-9f118f65ba58"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:49.899475 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.899455    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg" (OuterVolumeSpecName: "kube-api-access-z5zxg") pod "a827cf33-763e-4632-9c32-9f118f65ba58" (UID: "a827cf33-763e-4632-9c32-9f118f65ba58"). InnerVolumeSpecName "kube-api-access-z5zxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:05:49.903081 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.903059    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util" (OuterVolumeSpecName: "util") pod "a827cf33-763e-4632-9c32-9f118f65ba58" (UID: "a827cf33-763e-4632-9c32-9f118f65ba58"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:49.998031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.997954    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-util\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:49.998031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.997985    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a827cf33-763e-4632-9c32-9f118f65ba58-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:49.998031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:49.997998    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5zxg\" (UniqueName: \"kubernetes.io/projected/a827cf33-763e-4632-9c32-9f118f65ba58-kube-api-access-z5zxg\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:50.698061 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.698033    2558 generic.go:356] "Generic (PLEG): container finished" podID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerID="d92c9d6cf0014cd2bc4523604e3556838c6bb5b3df04b08a10e2e1ed252ed4cf" exitCode=0
Jul 10 23:05:50.698535 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.698122    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt" event={"ID":"958d9dd1-e48d-4778-98cb-bb0518a5b943","Type":"ContainerDied","Data":"d92c9d6cf0014cd2bc4523604e3556838c6bb5b3df04b08a10e2e1ed252ed4cf"}
Jul 10 23:05:50.700224 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.700207    2558 generic.go:356] "Generic (PLEG): container finished" podID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerID="8bef1031f8801edf011020cf98943277548e9b8c6ae3126e405cef4ad558ab34" exitCode=0
Jul 10 23:05:50.700315 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.700288    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p" event={"ID":"821f1a6b-974e-48fa-bed3-0f3c5a440277","Type":"ContainerDied","Data":"8bef1031f8801edf011020cf98943277548e9b8c6ae3126e405cef4ad558ab34"}
Jul 10 23:05:50.702089 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.702068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8" event={"ID":"a827cf33-763e-4632-9c32-9f118f65ba58","Type":"ContainerDied","Data":"6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655"}
Jul 10 23:05:50.702178 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.702109    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6143d5a2f25e3aeb520fa19689779bc4edbe14d2d4d49d91aa6fcf5e145b4655"
Jul 10 23:05:50.702249 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.702235    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8"
Jul 10 23:05:50.833359 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.833335    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:50.906541 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.906479    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle\") pod \"709dd745-71f6-44cc-ab18-d647a6d007b5\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") "
Jul 10 23:05:50.906694 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.906566    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util\") pod \"709dd745-71f6-44cc-ab18-d647a6d007b5\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") "
Jul 10 23:05:50.906694 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.906615    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5nr4\" (UniqueName: \"kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4\") pod \"709dd745-71f6-44cc-ab18-d647a6d007b5\" (UID: \"709dd745-71f6-44cc-ab18-d647a6d007b5\") "
Jul 10 23:05:50.907025 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.907003    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle" (OuterVolumeSpecName: "bundle") pod "709dd745-71f6-44cc-ab18-d647a6d007b5" (UID: "709dd745-71f6-44cc-ab18-d647a6d007b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:50.908732 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.908713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4" (OuterVolumeSpecName: "kube-api-access-v5nr4") pod "709dd745-71f6-44cc-ab18-d647a6d007b5" (UID: "709dd745-71f6-44cc-ab18-d647a6d007b5"). InnerVolumeSpecName "kube-api-access-v5nr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:05:50.911482 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:50.911435    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util" (OuterVolumeSpecName: "util") pod "709dd745-71f6-44cc-ab18-d647a6d007b5" (UID: "709dd745-71f6-44cc-ab18-d647a6d007b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:51.008002 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.007968    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5nr4\" (UniqueName: \"kubernetes.io/projected/709dd745-71f6-44cc-ab18-d647a6d007b5-kube-api-access-v5nr4\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:51.008002 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.007996    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:51.008002 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.008006    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/709dd745-71f6-44cc-ab18-d647a6d007b5-util\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:51.708337 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.708308    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn"
Jul 10 23:05:51.708337 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.708313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn" event={"ID":"709dd745-71f6-44cc-ab18-d647a6d007b5","Type":"ContainerDied","Data":"f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215"}
Jul 10 23:05:51.708775 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.708369    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3f1f93c98abeda0f81478d81c79e3c1b3c9cc0ff405fb0d414b97db6a391215"
Jul 10 23:05:51.868864 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.868840    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:51.870904 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.870882    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:51.916093 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916068    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util\") pod \"821f1a6b-974e-48fa-bed3-0f3c5a440277\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") "
Jul 10 23:05:51.916266 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916100    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6l6k\" (UniqueName: \"kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k\") pod \"821f1a6b-974e-48fa-bed3-0f3c5a440277\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") "
Jul 10 23:05:51.916266 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916124    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle\") pod \"958d9dd1-e48d-4778-98cb-bb0518a5b943\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") "
Jul 10 23:05:51.916266 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4t8j\" (UniqueName: \"kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j\") pod \"958d9dd1-e48d-4778-98cb-bb0518a5b943\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") "
Jul 10 23:05:51.916266 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916170    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle\") pod \"821f1a6b-974e-48fa-bed3-0f3c5a440277\" (UID: \"821f1a6b-974e-48fa-bed3-0f3c5a440277\") "
Jul 10 23:05:51.916460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util\") pod \"958d9dd1-e48d-4778-98cb-bb0518a5b943\" (UID: \"958d9dd1-e48d-4778-98cb-bb0518a5b943\") "
Jul 10 23:05:51.916793 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle" (OuterVolumeSpecName: "bundle") pod "958d9dd1-e48d-4778-98cb-bb0518a5b943" (UID: "958d9dd1-e48d-4778-98cb-bb0518a5b943"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:51.916906 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.916881    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle" (OuterVolumeSpecName: "bundle") pod "821f1a6b-974e-48fa-bed3-0f3c5a440277" (UID: "821f1a6b-974e-48fa-bed3-0f3c5a440277"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:51.918369 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.918341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j" (OuterVolumeSpecName: "kube-api-access-p4t8j") pod "958d9dd1-e48d-4778-98cb-bb0518a5b943" (UID: "958d9dd1-e48d-4778-98cb-bb0518a5b943"). InnerVolumeSpecName "kube-api-access-p4t8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:05:51.918675 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.918654    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k" (OuterVolumeSpecName: "kube-api-access-p6l6k") pod "821f1a6b-974e-48fa-bed3-0f3c5a440277" (UID: "821f1a6b-974e-48fa-bed3-0f3c5a440277"). InnerVolumeSpecName "kube-api-access-p6l6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:05:51.921950 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.921912    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util" (OuterVolumeSpecName: "util") pod "958d9dd1-e48d-4778-98cb-bb0518a5b943" (UID: "958d9dd1-e48d-4778-98cb-bb0518a5b943"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:51.922761 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:51.922741    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util" (OuterVolumeSpecName: "util") pod "821f1a6b-974e-48fa-bed3-0f3c5a440277" (UID: "821f1a6b-974e-48fa-bed3-0f3c5a440277"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017166    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-util\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017193    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-util\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017203    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6l6k\" (UniqueName: \"kubernetes.io/projected/821f1a6b-974e-48fa-bed3-0f3c5a440277-kube-api-access-p6l6k\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017212    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/958d9dd1-e48d-4778-98cb-bb0518a5b943-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017221    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4t8j\" (UniqueName: \"kubernetes.io/projected/958d9dd1-e48d-4778-98cb-bb0518a5b943-kube-api-access-p4t8j\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.017243 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.017228    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/821f1a6b-974e-48fa-bed3-0f3c5a440277-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:05:52.718789 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.718758    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt"
Jul 10 23:05:52.719139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.718753    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt" event={"ID":"958d9dd1-e48d-4778-98cb-bb0518a5b943","Type":"ContainerDied","Data":"27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416"}
Jul 10 23:05:52.719139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.718908    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27c6a6f143f40194a914ef26148f031fe4c49a6843f750be9a7b4cd836a2a416"
Jul 10 23:05:52.720702 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.720673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p" event={"ID":"821f1a6b-974e-48fa-bed3-0f3c5a440277","Type":"ContainerDied","Data":"0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26"}
Jul 10 23:05:52.720890 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.720704    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p"
Jul 10 23:05:52.720890 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:52.720717    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ac9f848bc377682b07394fa7096d89aeaa684d89ab19fec89fe0f2fe6a37f26"
Jul 10 23:05:54.731557 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:54.731364    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:05:54.764681 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:05:54.731817    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:06:03.148524 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.148473    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"]
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.148953    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.148971    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.148989    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.148998    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149007    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149016    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149026    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149035    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="util"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149045    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149053    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149067    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="extract"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149076    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="extract"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149088    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149096    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="pull"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149109    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="extract"
Jul 10 23:06:03.149112 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149117    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149131    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149138    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149149    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149157    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149173    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="util"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149182    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="util"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149190    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="pull"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149198    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="pull"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149275    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="821f1a6b-974e-48fa-bed3-0f3c5a440277" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149286    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a827cf33-763e-4632-9c32-9f118f65ba58" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149296    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="709dd745-71f6-44cc-ab18-d647a6d007b5" containerName="extract"
Jul 10 23:06:03.149936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.149304    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="958d9dd1-e48d-4778-98cb-bb0518a5b943" containerName="extract"
Jul 10 23:06:03.152683 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.152659    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:03.156063 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.156038    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qt2wc\""
Jul 10 23:06:03.166326 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.166297    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"]
Jul 10 23:06:03.204900 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.204857    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxsn\" (UniqueName: \"kubernetes.io/projected/d732f700-8218-4129-950d-cd8ffb8ca053-kube-api-access-2mxsn\") pod \"authorino-operator-75cc8d5cb7-jsg9p\" (UID: \"d732f700-8218-4129-950d-cd8ffb8ca053\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:03.305490 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.305428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxsn\" (UniqueName: \"kubernetes.io/projected/d732f700-8218-4129-950d-cd8ffb8ca053-kube-api-access-2mxsn\") pod \"authorino-operator-75cc8d5cb7-jsg9p\" (UID: \"d732f700-8218-4129-950d-cd8ffb8ca053\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:03.319402 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.319370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxsn\" (UniqueName: \"kubernetes.io/projected/d732f700-8218-4129-950d-cd8ffb8ca053-kube-api-access-2mxsn\") pod \"authorino-operator-75cc8d5cb7-jsg9p\" (UID: \"d732f700-8218-4129-950d-cd8ffb8ca053\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:03.462657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.462564    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:03.604291 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.603884    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"]
Jul 10 23:06:03.609382 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.609361    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:06:03.777432 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:03.777344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p" event={"ID":"d732f700-8218-4129-950d-cd8ffb8ca053","Type":"ContainerStarted","Data":"08262fba4f5a10b87ed17136a6ac88643100cb4effea1803227048c55c45435d"}
Jul 10 23:06:06.795201 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:06.795164    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p" event={"ID":"d732f700-8218-4129-950d-cd8ffb8ca053","Type":"ContainerStarted","Data":"f8994aca848962ff94a5e17ff73c213d46014640878edf9cb530f3958c9f9b7f"}
Jul 10 23:06:06.795650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:06.795253    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:06.812291 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:06.812243    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p" podStartSLOduration=1.45404861 podStartE2EDuration="3.812225552s" totalImagesPullingTime="2.358176942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:06.810919466 +0000 UTC m=+612.786474468" watchObservedRunningTime="2026-07-10 23:06:06.812225552 +0000 UTC m=+612.787780553"
Jul 10 23:06:08.326605 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.326573    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"]
Jul 10 23:06:08.334328 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.334303    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.336552 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.336531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clz7w\""
Jul 10 23:06:08.346918 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.346891    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"]
Jul 10 23:06:08.457474 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.457438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm2lq\" (UniqueName: \"kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.457685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.457526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.558517 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.558472    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm2lq\" (UniqueName: \"kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.558726 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.558554    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.558905 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.558886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.573539 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.573495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm2lq\" (UniqueName: \"kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.643594 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.643566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:08.792822 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.792796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"]
Jul 10 23:06:08.795187 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:08.795162    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fa6310_6ea5_4f8d_8a75_4919c02d9634.slice/crio-1f4f1ddfea9d8c9a9a92da4d764759b9ecbd906c73231b3c08e199e655e5d33a WatchSource:0}: Error finding container 1f4f1ddfea9d8c9a9a92da4d764759b9ecbd906c73231b3c08e199e655e5d33a: Status 404 returned error can't find the container with id 1f4f1ddfea9d8c9a9a92da4d764759b9ecbd906c73231b3c08e199e655e5d33a
Jul 10 23:06:08.804485 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:08.804454    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6" event={"ID":"46fa6310-6ea5-4f8d-8a75-4919c02d9634","Type":"ContainerStarted","Data":"1f4f1ddfea9d8c9a9a92da4d764759b9ecbd906c73231b3c08e199e655e5d33a"}
Jul 10 23:06:11.328732 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.328692    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"]
Jul 10 23:06:11.332557 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.332537    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:11.334873 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.334854    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-27xch\""
Jul 10 23:06:11.343232 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.343207    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"]
Jul 10 23:06:11.485913 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.485876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwd9x\" (UniqueName: \"kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x\") pod \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" (UID: \"c1451760-812b-4e4c-b0d2-0525eba2ddc7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:11.586432 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.586338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwd9x\" (UniqueName: \"kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x\") pod \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" (UID: \"c1451760-812b-4e4c-b0d2-0525eba2ddc7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:11.595543 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.595490    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwd9x\" (UniqueName: \"kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x\") pod \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" (UID: \"c1451760-812b-4e4c-b0d2-0525eba2ddc7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:11.646015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.645990    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:11.790257 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.790235    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"]
Jul 10 23:06:11.792364 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:11.792335    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1451760_812b_4e4c_b0d2_0525eba2ddc7.slice/crio-398a41e5df29cb014c2f41f604d878376784ee1ede1dca476748b8a35dd7e4fc WatchSource:0}: Error finding container 398a41e5df29cb014c2f41f604d878376784ee1ede1dca476748b8a35dd7e4fc: Status 404 returned error can't find the container with id 398a41e5df29cb014c2f41f604d878376784ee1ede1dca476748b8a35dd7e4fc
Jul 10 23:06:11.821425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:11.821392    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n" event={"ID":"c1451760-812b-4e4c-b0d2-0525eba2ddc7","Type":"ContainerStarted","Data":"398a41e5df29cb014c2f41f604d878376784ee1ede1dca476748b8a35dd7e4fc"}
Jul 10 23:06:13.744553 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.744492    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"]
Jul 10 23:06:13.751330 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.751293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:13.753760 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.753735    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 10 23:06:13.753911 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.753793    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mftvb\""
Jul 10 23:06:13.758861 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.758836    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"]
Jul 10 23:06:13.906409 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.906362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjc7\" (UniqueName: \"kubernetes.io/projected/ce5ec8a7-d7c7-487b-bef8-c5db85705ecc-kube-api-access-jvjc7\") pod \"dns-operator-controller-manager-864dd78c4c-cp5cc\" (UID: \"ce5ec8a7-d7c7-487b-bef8-c5db85705ecc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:13.921851 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.921819    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845575b679-ck8m5"]
Jul 10 23:06:13.925553 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.925531    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:13.941407 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:13.941378    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845575b679-ck8m5"]
Jul 10 23:06:14.007783 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.007690    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjc7\" (UniqueName: \"kubernetes.io/projected/ce5ec8a7-d7c7-487b-bef8-c5db85705ecc-kube-api-access-jvjc7\") pod \"dns-operator-controller-manager-864dd78c4c-cp5cc\" (UID: \"ce5ec8a7-d7c7-487b-bef8-c5db85705ecc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:14.022204 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.022170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjc7\" (UniqueName: \"kubernetes.io/projected/ce5ec8a7-d7c7-487b-bef8-c5db85705ecc-kube-api-access-jvjc7\") pod \"dns-operator-controller-manager-864dd78c4c-cp5cc\" (UID: \"ce5ec8a7-d7c7-487b-bef8-c5db85705ecc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:14.064977 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.064935    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:14.108509 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-service-ca\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108701 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspr2\" (UniqueName: \"kubernetes.io/projected/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-kube-api-access-qspr2\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108701 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-trusted-ca-bundle\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108701 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108701 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108893 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108718    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-oauth-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.108893 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.108770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-oauth-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209329 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-trusted-ca-bundle\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209392    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-oauth-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209473    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-oauth-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209772 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209533    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-service-ca\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.209772 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.209559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qspr2\" (UniqueName: \"kubernetes.io/projected/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-kube-api-access-qspr2\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.210276 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.210252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-trusted-ca-bundle\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.210696 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.210526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-oauth-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.210824 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.210704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-service-ca\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.210824 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.210733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.212344 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.212323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-oauth-config\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.212565 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.212547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-console-serving-cert\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.220394 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.220374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspr2\" (UniqueName: \"kubernetes.io/projected/8caa5191-706d-4fe7-ad3d-7f8c3cee4053-kube-api-access-qspr2\") pod \"console-845575b679-ck8m5\" (UID: \"8caa5191-706d-4fe7-ad3d-7f8c3cee4053\") " pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.236832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.236804    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:14.974079 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.974012    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"]
Jul 10 23:06:14.976955 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:14.976923    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5ec8a7_d7c7_487b_bef8_c5db85705ecc.slice/crio-3566c09de33caff081ec4db542cfe88f9154d054aab2511f770882ef0bc7bd0e WatchSource:0}: Error finding container 3566c09de33caff081ec4db542cfe88f9154d054aab2511f770882ef0bc7bd0e: Status 404 returned error can't find the container with id 3566c09de33caff081ec4db542cfe88f9154d054aab2511f770882ef0bc7bd0e
Jul 10 23:06:14.988869 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:14.988847    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845575b679-ck8m5"]
Jul 10 23:06:14.990798 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:14.990774    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8caa5191_706d_4fe7_ad3d_7f8c3cee4053.slice/crio-b9914660c9923e7ca88802ab44f63edf7d0cdb0dcd952e28cad37bfffca5708b WatchSource:0}: Error finding container b9914660c9923e7ca88802ab44f63edf7d0cdb0dcd952e28cad37bfffca5708b: Status 404 returned error can't find the container with id b9914660c9923e7ca88802ab44f63edf7d0cdb0dcd952e28cad37bfffca5708b
Jul 10 23:06:15.847526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.847472    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6" event={"ID":"46fa6310-6ea5-4f8d-8a75-4919c02d9634","Type":"ContainerStarted","Data":"3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd"}
Jul 10 23:06:15.847712 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.847627    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:15.849461 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.849429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845575b679-ck8m5" event={"ID":"8caa5191-706d-4fe7-ad3d-7f8c3cee4053","Type":"ContainerStarted","Data":"a6e30dd1d6e688ef69db632deafa2b23bd22290d8381769160f2dd20afed430b"}
Jul 10 23:06:15.849605 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.849514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845575b679-ck8m5" event={"ID":"8caa5191-706d-4fe7-ad3d-7f8c3cee4053","Type":"ContainerStarted","Data":"b9914660c9923e7ca88802ab44f63edf7d0cdb0dcd952e28cad37bfffca5708b"}
Jul 10 23:06:15.851174 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.851114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc" event={"ID":"ce5ec8a7-d7c7-487b-bef8-c5db85705ecc","Type":"ContainerStarted","Data":"3566c09de33caff081ec4db542cfe88f9154d054aab2511f770882ef0bc7bd0e"}
Jul 10 23:06:15.853494 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.853060    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n" event={"ID":"c1451760-812b-4e4c-b0d2-0525eba2ddc7","Type":"ContainerStarted","Data":"29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41"}
Jul 10 23:06:15.853494 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.853231    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:15.868870 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.868813    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6" podStartSLOduration=1.8450641719999998 podStartE2EDuration="7.868791778s" totalImagesPullingTime="6.023727606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:15.86660293 +0000 UTC m=+621.842157932" watchObservedRunningTime="2026-07-10 23:06:15.868791778 +0000 UTC m=+621.844346782"
Jul 10 23:06:15.884994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.884934    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n" podStartSLOduration=1.8745189309999999 podStartE2EDuration="4.88491338s" totalImagesPullingTime="3.010394449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:15.883392872 +0000 UTC m=+621.858947872" watchObservedRunningTime="2026-07-10 23:06:15.88491338 +0000 UTC m=+621.860468384"
Jul 10 23:06:15.901215 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:15.901162    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845575b679-ck8m5" podStartSLOduration=2.9011439 podStartE2EDuration="2.9011439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:15.89975723 +0000 UTC m=+621.875312237" watchObservedRunningTime="2026-07-10 23:06:15.9011439 +0000 UTC m=+621.876698902"
Jul 10 23:06:17.790384 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.790343    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"]
Jul 10 23:06:17.793764 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.793745    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:17.795963 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.795940    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 23:06:17.796083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.795949    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 23:06:17.796083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.795975    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6pg8v\""
Jul 10 23:06:17.800925 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.800889    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"]
Jul 10 23:06:17.801346 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.801328    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsg9p"
Jul 10 23:06:17.865996 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.865965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc" event={"ID":"ce5ec8a7-d7c7-487b-bef8-c5db85705ecc","Type":"ContainerStarted","Data":"6992d9d087ee28ac453e96bf47737b71af5376f79addba8e200969a02eac589f"}
Jul 10 23:06:17.866140 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.866093    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:17.883688 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.883636    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc" podStartSLOduration=2.878131519 podStartE2EDuration="4.88362171s" totalImagesPullingTime="2.005490191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:17.882892783 +0000 UTC m=+623.858447786" watchObservedRunningTime="2026-07-10 23:06:17.88362171 +0000 UTC m=+623.859176712"
Jul 10 23:06:17.949807 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.949774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:17.949980 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.949833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc4pl\" (UniqueName: \"kubernetes.io/projected/039c16dc-d656-4159-9430-6702991cf39c-kube-api-access-bc4pl\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:17.949980 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:17.949860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/039c16dc-d656-4159-9430-6702991cf39c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.051191 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.051094    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.051191 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.051146    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc4pl\" (UniqueName: \"kubernetes.io/projected/039c16dc-d656-4159-9430-6702991cf39c-kube-api-access-bc4pl\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.051191 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.051164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/039c16dc-d656-4159-9430-6702991cf39c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.051464 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:18.051257    2558 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 10 23:06:18.051464 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:18.051333    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert podName:039c16dc-d656-4159-9430-6702991cf39c nodeName:}" failed. No retries permitted until 2026-07-10 23:06:18.551312056 +0000 UTC m=+624.526867056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rnlwx" (UID: "039c16dc-d656-4159-9430-6702991cf39c") : secret "plugin-serving-cert" not found
Jul 10 23:06:18.051823 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.051806    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/039c16dc-d656-4159-9430-6702991cf39c-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.063657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.063632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc4pl\" (UniqueName: \"kubernetes.io/projected/039c16dc-d656-4159-9430-6702991cf39c-kube-api-access-bc4pl\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.554917 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.554888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.557405 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.557384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/039c16dc-d656-4159-9430-6702991cf39c-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rnlwx\" (UID: \"039c16dc-d656-4159-9430-6702991cf39c\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.704683 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.704648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"
Jul 10 23:06:18.835050 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.835026    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx"]
Jul 10 23:06:18.837128 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:18.837089    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod039c16dc_d656_4159_9430_6702991cf39c.slice/crio-0e6a2bb7626dd0c6b3f2c9e4f2ae881058d89105f5671a6afd00e2998b210e5f WatchSource:0}: Error finding container 0e6a2bb7626dd0c6b3f2c9e4f2ae881058d89105f5671a6afd00e2998b210e5f: Status 404 returned error can't find the container with id 0e6a2bb7626dd0c6b3f2c9e4f2ae881058d89105f5671a6afd00e2998b210e5f
Jul 10 23:06:18.871479 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:18.871447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx" event={"ID":"039c16dc-d656-4159-9430-6702991cf39c","Type":"ContainerStarted","Data":"0e6a2bb7626dd0c6b3f2c9e4f2ae881058d89105f5671a6afd00e2998b210e5f"}
Jul 10 23:06:24.237060 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:24.237022    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:24.237060 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:24.237091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:24.243485 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:24.243460    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:24.911785 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:24.911755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845575b679-ck8m5"
Jul 10 23:06:24.964632 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:24.964600    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:06:26.860639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:26.860606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:26.861072 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:26.860693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:28.187257 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.187220    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"]
Jul 10 23:06:28.197377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.197344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.213970 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.213920    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"]
Jul 10 23:06:28.246739 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.246705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p62wh\" (UniqueName: \"kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.246924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.246753    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.337763 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.337728    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"]
Jul 10 23:06:28.338098 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.338066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-p62wh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d"
Jul 10 23:06:28.347466 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.347435    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p62wh\" (UniqueName: \"kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.347637 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.347496    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.347966 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.347945    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.361238 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.361214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p62wh\" (UniqueName: \"kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.375265 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.375234    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"]
Jul 10 23:06:28.381520 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.381467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.391851 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.391811    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"]
Jul 10 23:06:28.448143 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.448053    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btlj7\" (UniqueName: \"kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.448287 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.448191    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.549460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.549423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btlj7\" (UniqueName: \"kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.549673 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.549534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.549898 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.549877    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.563590 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.563563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btlj7\" (UniqueName: \"kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7\") pod \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.695599 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.695556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:28.847518 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.847463    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"]
Jul 10 23:06:28.861679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.861648    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"]
Jul 10 23:06:28.866908 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.866872    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:06:28.872209 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.872172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:28.874100 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.874078    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cp5cc"
Jul 10 23:06:28.875213 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.875191    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"]
Jul 10 23:06:28.881479 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.881459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:06:28.886101 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.886079    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"]
Jul 10 23:06:28.901707 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.901677    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"]
Jul 10 23:06:28.901899 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.901876    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" containerName="manager" containerID="cri-o://3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd" gracePeriod=2
Jul 10 23:06:28.904487 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.904464    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"]
Jul 10 23:06:28.913735 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.913709    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"]
Jul 10 23:06:28.913933 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.913906    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" containerName="manager" containerID="cri-o://29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41" gracePeriod=2
Jul 10 23:06:28.919604 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.919565    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:28.921442 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.920856    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"]
Jul 10 23:06:28.922161 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.922131    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:28.926249 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926221    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:28.926733 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926714    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" containerName="manager"
Jul 10 23:06:28.926733 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926735    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" containerName="manager"
Jul 10 23:06:28.926891 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926769    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" containerName="manager"
Jul 10 23:06:28.926891 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926777    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" containerName="manager"
Jul 10 23:06:28.926891 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926858    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" containerName="manager"
Jul 10 23:06:28.926891 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.926871    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" containerName="manager"
Jul 10 23:06:28.929277 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.929221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.930377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.930358    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:28.931492 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.931453    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:28.933298 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.933272    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:28.935026 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.935003    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.938972 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.938925    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:28.941240 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.941216    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:28.941909 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.941882    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:28.953281 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.953248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:28.953412 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.953320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:28.953628 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.953588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqt7w\" (UniqueName: \"kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:28.953735 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:28.953701    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j44q\" (UniqueName: \"kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:28.967623 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:28.967575    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:29.015739 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.015711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:29.018659 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.018625    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:29.020730 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.020700    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:29.022698 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.022667    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:29.054867 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.054839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p62wh\" (UniqueName: \"kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh\") pod \"2d0096ec-65cd-491e-8739-f039d4d32f3d\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") "
Jul 10 23:06:29.055016 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.054896    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume\") pod \"2d0096ec-65cd-491e-8739-f039d4d32f3d\" (UID: \"2d0096ec-65cd-491e-8739-f039d4d32f3d\") "
Jul 10 23:06:29.055431 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.055396    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2d0096ec-65cd-491e-8739-f039d4d32f3d" (UID: "2d0096ec-65cd-491e-8739-f039d4d32f3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:06:29.055559 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.055406    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j44q\" (UniqueName: \"kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:29.055668 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.055624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:29.055737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.055704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:29.055802 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.055778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqt7w\" (UniqueName: \"kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:29.056362 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.056318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:29.056517 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.056464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:29.056620 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.056601    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d0096ec-65cd-491e-8739-f039d4d32f3d-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:29.064798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.064771    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh" (OuterVolumeSpecName: "kube-api-access-p62wh") pod "2d0096ec-65cd-491e-8739-f039d4d32f3d" (UID: "2d0096ec-65cd-491e-8739-f039d4d32f3d"). InnerVolumeSpecName "kube-api-access-p62wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:29.065129 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.065103    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqt7w\" (UniqueName: \"kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w\") pod \"kuadrant-operator-controller-manager-55467d9f7-zvtdk\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:29.065211 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.065164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j44q\" (UniqueName: \"kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wv4km\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:29.157438 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.157397    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p62wh\" (UniqueName: \"kubernetes.io/projected/2d0096ec-65cd-491e-8739-f039d4d32f3d-kube-api-access-p62wh\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:29.188259 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.188219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:29.323847 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.323750    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:29.935531 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:29.935483    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:29.937928 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.937887    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:29.939761 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.939733    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:29.941566 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.941496    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:29.944610 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.944580    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:29.946291 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.946256    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-pwrnj\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pwrnj"
Jul 10 23:06:29.947982 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:29.947956    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:30.541741 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:30.541709    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0096ec-65cd-491e-8739-f039d4d32f3d" path="/var/lib/kubelet/pods/2d0096ec-65cd-491e-8739-f039d4d32f3d/volumes"
Jul 10 23:06:41.538671 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.538642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:06:41.540774 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:41.540745    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db1f2a2_124d_4c31_a4f3_d062cbef0895.slice/crio-3635192db42408456f0af9d1776e427617debdc2a0697affe273cddbe65cb4e6 WatchSource:0}: Error finding container 3635192db42408456f0af9d1776e427617debdc2a0697affe273cddbe65cb4e6: Status 404 returned error can't find the container with id 3635192db42408456f0af9d1776e427617debdc2a0697affe273cddbe65cb4e6
Jul 10 23:06:41.541737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.541710    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:41.543768 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:41.543724    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:41.545175 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.545154    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:41.546962 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:41.546927    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:41.549117 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:41.549092    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:41.575657 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:41.575630    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3842ab43_f176_44cd_a6e5_9e22f39c8f27.slice/crio-81a4c795277027dc4d89b0391272c2771f605193dc11f5d43822b2a645bc15af WatchSource:0}: Error finding container 81a4c795277027dc4d89b0391272c2771f605193dc11f5d43822b2a645bc15af: Status 404 returned error can't find the container with id 81a4c795277027dc4d89b0391272c2771f605193dc11f5d43822b2a645bc15af
Jul 10 23:06:41.577873 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.577769    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:41.684217 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.684185    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume\") pod \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") "
Jul 10 23:06:41.684384 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.684282    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwd9x\" (UniqueName: \"kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x\") pod \"c1451760-812b-4e4c-b0d2-0525eba2ddc7\" (UID: \"c1451760-812b-4e4c-b0d2-0525eba2ddc7\") "
Jul 10 23:06:41.684384 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.684320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm2lq\" (UniqueName: \"kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq\") pod \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\" (UID: \"46fa6310-6ea5-4f8d-8a75-4919c02d9634\") "
Jul 10 23:06:41.684708 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.684679    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46fa6310-6ea5-4f8d-8a75-4919c02d9634" (UID: "46fa6310-6ea5-4f8d-8a75-4919c02d9634"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:06:41.686354 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.686332    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x" (OuterVolumeSpecName: "kube-api-access-pwd9x") pod "c1451760-812b-4e4c-b0d2-0525eba2ddc7" (UID: "c1451760-812b-4e4c-b0d2-0525eba2ddc7"). InnerVolumeSpecName "kube-api-access-pwd9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:41.686448 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.686428    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq" (OuterVolumeSpecName: "kube-api-access-pm2lq") pod "46fa6310-6ea5-4f8d-8a75-4919c02d9634" (UID: "46fa6310-6ea5-4f8d-8a75-4919c02d9634"). InnerVolumeSpecName "kube-api-access-pm2lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:41.785888 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.785852    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwd9x\" (UniqueName: \"kubernetes.io/projected/c1451760-812b-4e4c-b0d2-0525eba2ddc7-kube-api-access-pwd9x\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:41.785888 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.785890    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm2lq\" (UniqueName: \"kubernetes.io/projected/46fa6310-6ea5-4f8d-8a75-4919c02d9634-kube-api-access-pm2lq\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:41.786088 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:41.785907    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46fa6310-6ea5-4f8d-8a75-4919c02d9634-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:42.005169 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.005131    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" event={"ID":"5db1f2a2-124d-4c31-a4f3-d062cbef0895","Type":"ContainerStarted","Data":"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"}
Jul 10 23:06:42.005335 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.005191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" event={"ID":"5db1f2a2-124d-4c31-a4f3-d062cbef0895","Type":"ContainerStarted","Data":"3635192db42408456f0af9d1776e427617debdc2a0697affe273cddbe65cb4e6"}
Jul 10 23:06:42.005335 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.005304    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:42.006621 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.006596    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx" event={"ID":"039c16dc-d656-4159-9430-6702991cf39c","Type":"ContainerStarted","Data":"2a0b9e788eaab1bac8b9f75c75e0c81f430f2c124c17e8fac82bfb947f97f317"}
Jul 10 23:06:42.007140 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.007118    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:42.008168 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.008146    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" event={"ID":"3842ab43-f176-44cd-a6e5-9e22f39c8f27","Type":"ContainerStarted","Data":"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"}
Jul 10 23:06:42.008230 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.008188    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" event={"ID":"3842ab43-f176-44cd-a6e5-9e22f39c8f27","Type":"ContainerStarted","Data":"81a4c795277027dc4d89b0391272c2771f605193dc11f5d43822b2a645bc15af"}
Jul 10 23:06:42.008230 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.008216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:42.009375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.009355    2558 generic.go:356] "Generic (PLEG): container finished" podID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" containerID="3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd" exitCode=0
Jul 10 23:06:42.009433 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.009416    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:42.009468 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.009449    2558 scope.go:117] "RemoveContainer" containerID="3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd"
Jul 10 23:06:42.010805 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.010783    2558 generic.go:356] "Generic (PLEG): container finished" podID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" containerID="29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41" exitCode=0
Jul 10 23:06:42.010893 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.010819    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:42.018236 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.018175    2558 scope.go:117] "RemoveContainer" containerID="3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd"
Jul 10 23:06:42.018483 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.018462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd\": container with ID starting with 3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd not found: ID does not exist" containerID="3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd"
Jul 10 23:06:42.018593 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.018490    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd"} err="failed to get container status \"3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd\": rpc error: code = NotFound desc = could not find container \"3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd\": container with ID starting with 3fc422519980a64f6c6e0c1068f7ac34c02b570d7c04a4c20dda510c242515cd not found: ID does not exist"
Jul 10 23:06:42.018593 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.018530    2558 scope.go:117] "RemoveContainer" containerID="29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41"
Jul 10 23:06:42.025357 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.025289    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:42.026026 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.025992    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" podStartSLOduration=14.025979072 podStartE2EDuration="14.025979072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:42.02354798 +0000 UTC m=+647.999102982" watchObservedRunningTime="2026-07-10 23:06:42.025979072 +0000 UTC m=+648.001534066"
Jul 10 23:06:42.027543 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.027485    2558 scope.go:117] "RemoveContainer" containerID="29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41"
Jul 10 23:06:42.027752 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.027726    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41\": container with ID starting with 29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41 not found: ID does not exist" containerID="29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41"
Jul 10 23:06:42.027831 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.027754    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41"} err="failed to get container status \"29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41\": rpc error: code = NotFound desc = could not find container \"29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41\": container with ID starting with 29e3e7dd768bd8a0e5c8f2dc90753e0cb70a4618e136c2a8c80342f8099f3e41 not found: ID does not exist"
Jul 10 23:06:42.043050 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.043008    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rnlwx" podStartSLOduration=2.4181924280000002 podStartE2EDuration="25.042995532s" totalImagesPullingTime="22.624803104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:42.041170616 +0000 UTC m=+648.016725617" watchObservedRunningTime="2026-07-10 23:06:42.042995532 +0000 UTC m=+648.018550555"
Jul 10 23:06:42.065854 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.064428    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" podStartSLOduration=14.064409452 podStartE2EDuration="14.064409452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:42.063393028 +0000 UTC m=+648.038948032" watchObservedRunningTime="2026-07-10 23:06:42.064409452 +0000 UTC m=+648.039964454"
Jul 10 23:06:42.067255 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.067134    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-x7px6\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-x7px6"
Jul 10 23:06:42.069160 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:42.069115    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7pw7n\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7pw7n"
Jul 10 23:06:42.540014 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.539981    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fa6310-6ea5-4f8d-8a75-4919c02d9634" path="/var/lib/kubelet/pods/46fa6310-6ea5-4f8d-8a75-4919c02d9634/volumes"
Jul 10 23:06:42.540381 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:42.540292    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1451760-812b-4e4c-b0d2-0525eba2ddc7" path="/var/lib/kubelet/pods/c1451760-812b-4e4c-b0d2-0525eba2ddc7/volumes"
Jul 10 23:06:43.904247 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:43.904194    2558 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-bpn9q_kuadrant-system_0cbc28ab-8a2a-4997-99da-41be305caf4a_0(223b2dbfda81c81b9a3b3d9e1e0a70b6fb9681855e5f738294b03f32be7d0589): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-bpn9q to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 10 23:06:43.904579 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:43.904279    2558 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-bpn9q_kuadrant-system_0cbc28ab-8a2a-4997-99da-41be305caf4a_0(223b2dbfda81c81b9a3b3d9e1e0a70b6fb9681855e5f738294b03f32be7d0589): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-bpn9q to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.023102 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.023063    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.025311 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:44.025276    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.031558 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.031540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.033320 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:44.033298    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.108321 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.108295    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btlj7\" (UniqueName: \"kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7\") pod \"0cbc28ab-8a2a-4997-99da-41be305caf4a\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") "
Jul 10 23:06:44.108462 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.108353    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume\") pod \"0cbc28ab-8a2a-4997-99da-41be305caf4a\" (UID: \"0cbc28ab-8a2a-4997-99da-41be305caf4a\") "
Jul 10 23:06:44.108667 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.108644    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0cbc28ab-8a2a-4997-99da-41be305caf4a" (UID: "0cbc28ab-8a2a-4997-99da-41be305caf4a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:06:44.110524 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.110489    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7" (OuterVolumeSpecName: "kube-api-access-btlj7") pod "0cbc28ab-8a2a-4997-99da-41be305caf4a" (UID: "0cbc28ab-8a2a-4997-99da-41be305caf4a"). InnerVolumeSpecName "kube-api-access-btlj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:44.209643 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.209564    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btlj7\" (UniqueName: \"kubernetes.io/projected/0cbc28ab-8a2a-4997-99da-41be305caf4a-kube-api-access-btlj7\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:44.209643 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.209590    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0cbc28ab-8a2a-4997-99da-41be305caf4a-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:44.539169 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:44.539083    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:44.540085 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:44.540068    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" path="/var/lib/kubelet/pods/0cbc28ab-8a2a-4997-99da-41be305caf4a/volumes"
Jul 10 23:06:45.027589 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:45.027558    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:45.029754 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:45.029723    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:45.031463 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:45.031441    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bpn9q\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="0cbc28ab-8a2a-4997-99da-41be305caf4a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bpn9q"
Jul 10 23:06:49.990245 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:49.990176    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b6cb65fb-b8rcf" podUID="d7416389-81ed-43b7-a504-3e811940874c" containerName="console" containerID="cri-o://33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943" gracePeriod=15
Jul 10 23:06:50.268265 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.268199    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:06:50.362930 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.362895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.362930 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.362929    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.362969    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.362993    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363029    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363072    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363100    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kjj2\" (UniqueName: \"kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2\") pod \"d7416389-81ed-43b7-a504-3e811940874c\" (UID: \"d7416389-81ed-43b7-a504-3e811940874c\") "
Jul 10 23:06:50.363530 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363454    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config" (OuterVolumeSpecName: "console-config") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:06:50.363530 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363484    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:06:50.363530 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363496    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:06:50.363726 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.363659    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:06:50.365480 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.365462    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2" (OuterVolumeSpecName: "kube-api-access-6kjj2") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "kube-api-access-6kjj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:50.365722 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.365696    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:06:50.365722 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.365707    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7416389-81ed-43b7-a504-3e811940874c" (UID: "d7416389-81ed-43b7-a504-3e811940874c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:06:50.464686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464655    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-trusted-ca-bundle\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464680    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464689    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kjj2\" (UniqueName: \"kubernetes.io/projected/d7416389-81ed-43b7-a504-3e811940874c-kube-api-access-6kjj2\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464902 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464698    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-serving-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464902 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464707    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7416389-81ed-43b7-a504-3e811940874c-console-oauth-config\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464902 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464715    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-console-config\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:50.464902 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:50.464724    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7416389-81ed-43b7-a504-3e811940874c-oauth-serving-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:51.059354 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.059319    2558 generic.go:356] "Generic (PLEG): container finished" podID="d7416389-81ed-43b7-a504-3e811940874c" containerID="33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943" exitCode=0
Jul 10 23:06:51.059779 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.059366    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6cb65fb-b8rcf"
Jul 10 23:06:51.059779 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.059412    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cb65fb-b8rcf" event={"ID":"d7416389-81ed-43b7-a504-3e811940874c","Type":"ContainerDied","Data":"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"}
Jul 10 23:06:51.059779 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.059466    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6cb65fb-b8rcf" event={"ID":"d7416389-81ed-43b7-a504-3e811940874c","Type":"ContainerDied","Data":"d74bb4b8bdf09e016fcdb44679f3099952ae62921f523155367763297c4ee3c6"}
Jul 10 23:06:51.059779 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.059492    2558 scope.go:117] "RemoveContainer" containerID="33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"
Jul 10 23:06:51.067927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.067905    2558 scope.go:117] "RemoveContainer" containerID="33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"
Jul 10 23:06:51.068191 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:51.068169    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943\": container with ID starting with 33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943 not found: ID does not exist" containerID="33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"
Jul 10 23:06:51.068258 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.068203    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943"} err="failed to get container status \"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943\": rpc error: code = NotFound desc = could not find container \"33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943\": container with ID starting with 33a98c114920567c2fe4f722170cab88b8ce7e53a67f322aaf9d8ddc2969b943 not found: ID does not exist"
Jul 10 23:06:51.074727 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.074707    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:06:51.080355 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:51.080329    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6cb65fb-b8rcf"]
Jul 10 23:06:52.540191 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:52.540156    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7416389-81ed-43b7-a504-3e811940874c" path="/var/lib/kubelet/pods/d7416389-81ed-43b7-a504-3e811940874c/volumes"
Jul 10 23:06:53.020380 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.020349    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:06:53.020597 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.020431    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:53.084945 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.084917    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:53.085126 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.085098    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" podUID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" containerName="manager" containerID="cri-o://43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95" gracePeriod=10
Jul 10 23:06:53.311003 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.310925    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:06:53.311427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.311411    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7416389-81ed-43b7-a504-3e811940874c" containerName="console"
Jul 10 23:06:53.311473 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.311431    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7416389-81ed-43b7-a504-3e811940874c" containerName="console"
Jul 10 23:06:53.311570 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.311557    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7416389-81ed-43b7-a504-3e811940874c" containerName="console"
Jul 10 23:06:53.315292 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.315275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.324413 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.324390    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:06:53.349641 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.349621    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:53.493672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.493641    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume\") pod \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") "
Jul 10 23:06:53.493838 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.493695    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j44q\" (UniqueName: \"kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q\") pod \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\" (UID: \"3842ab43-f176-44cd-a6e5-9e22f39c8f27\") "
Jul 10 23:06:53.493929 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.493908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8mc\" (UniqueName: \"kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.493984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.493968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.494019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.494002    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3842ab43-f176-44cd-a6e5-9e22f39c8f27" (UID: "3842ab43-f176-44cd-a6e5-9e22f39c8f27"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:06:53.495910 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.495884    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q" (OuterVolumeSpecName: "kube-api-access-8j44q") pod "3842ab43-f176-44cd-a6e5-9e22f39c8f27" (UID: "3842ab43-f176-44cd-a6e5-9e22f39c8f27"). InnerVolumeSpecName "kube-api-access-8j44q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:06:53.594716 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.594619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8mc\" (UniqueName: \"kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.594716 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.594686    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.595111 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.594728    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j44q\" (UniqueName: \"kubernetes.io/projected/3842ab43-f176-44cd-a6e5-9e22f39c8f27-kube-api-access-8j44q\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:53.595111 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.594742    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3842ab43-f176-44cd-a6e5-9e22f39c8f27-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:06:53.595111 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.595010    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.602374 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.602353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8mc\" (UniqueName: \"kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc\") pod \"kuadrant-operator-controller-manager-86878c769f-mjlsb\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.627388 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.627346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:53.763672 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:53.763644    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:06:53.765787 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:06:53.765759    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba864cb4_fb27_463b_96d6_7e27ced43ef9.slice/crio-a76a319d086fa6e6b5e3c804b95c5e006184196140ace6192ec8a13fa67381e5 WatchSource:0}: Error finding container a76a319d086fa6e6b5e3c804b95c5e006184196140ace6192ec8a13fa67381e5: Status 404 returned error can't find the container with id a76a319d086fa6e6b5e3c804b95c5e006184196140ace6192ec8a13fa67381e5
Jul 10 23:06:54.078517 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.078468    2558 generic.go:356] "Generic (PLEG): container finished" podID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" containerID="43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95" exitCode=0
Jul 10 23:06:54.078690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.078535    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" event={"ID":"3842ab43-f176-44cd-a6e5-9e22f39c8f27","Type":"ContainerDied","Data":"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"}
Jul 10 23:06:54.078690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.078590    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km" event={"ID":"3842ab43-f176-44cd-a6e5-9e22f39c8f27","Type":"ContainerDied","Data":"81a4c795277027dc4d89b0391272c2771f605193dc11f5d43822b2a645bc15af"}
Jul 10 23:06:54.078690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.078539    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"
Jul 10 23:06:54.078690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.078621    2558 scope.go:117] "RemoveContainer" containerID="43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"
Jul 10 23:06:54.083621 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.083592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" event={"ID":"ba864cb4-fb27-463b-96d6-7e27ced43ef9","Type":"ContainerStarted","Data":"821ee13b1867fa9463f0801d42f8a174b9fc9931449f643d8b9a97242b96ee5d"}
Jul 10 23:06:54.083739 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.083639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" event={"ID":"ba864cb4-fb27-463b-96d6-7e27ced43ef9","Type":"ContainerStarted","Data":"a76a319d086fa6e6b5e3c804b95c5e006184196140ace6192ec8a13fa67381e5"}
Jul 10 23:06:54.083739 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.083676    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:06:54.092122 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.091936    2558 scope.go:117] "RemoveContainer" containerID="43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"
Jul 10 23:06:54.092209 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:06:54.092193    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95\": container with ID starting with 43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95 not found: ID does not exist" containerID="43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"
Jul 10 23:06:54.092250 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.092216    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95"} err="failed to get container status \"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95\": rpc error: code = NotFound desc = could not find container \"43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95\": container with ID starting with 43dea19bdbd2ba0c9b435eb535d2224487790ddff0813877980406f4218f7b95 not found: ID does not exist"
Jul 10 23:06:54.102450 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.102405    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" podStartSLOduration=1.102390287 podStartE2EDuration="1.102390287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:06:54.099555737 +0000 UTC m=+660.075110735" watchObservedRunningTime="2026-07-10 23:06:54.102390287 +0000 UTC m=+660.077945346"
Jul 10 23:06:54.112583 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.112561    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:54.118675 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.118646    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wv4km"]
Jul 10 23:06:54.539688 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:06:54.539657    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" path="/var/lib/kubelet/pods/3842ab43-f176-44cd-a6e5-9e22f39c8f27/volumes"
Jul 10 23:07:05.090467 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.090433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:07:05.144684 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.144650    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:07:05.144928 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.144898    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" podUID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" containerName="manager" containerID="cri-o://e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1" gracePeriod=10
Jul 10 23:07:05.944398 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.944368    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:07:05.998782 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.998744    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqt7w\" (UniqueName: \"kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w\") pod \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") "
Jul 10 23:07:05.998958 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.998876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume\") pod \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\" (UID: \"5db1f2a2-124d-4c31-a4f3-d062cbef0895\") "
Jul 10 23:07:05.999248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:05.999226    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5db1f2a2-124d-4c31-a4f3-d062cbef0895" (UID: "5db1f2a2-124d-4c31-a4f3-d062cbef0895"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:07:06.001059 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.001031    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w" (OuterVolumeSpecName: "kube-api-access-xqt7w") pod "5db1f2a2-124d-4c31-a4f3-d062cbef0895" (UID: "5db1f2a2-124d-4c31-a4f3-d062cbef0895"). InnerVolumeSpecName "kube-api-access-xqt7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:07:06.099669 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.099580    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqt7w\" (UniqueName: \"kubernetes.io/projected/5db1f2a2-124d-4c31-a4f3-d062cbef0895-kube-api-access-xqt7w\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:07:06.099669 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.099609    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5db1f2a2-124d-4c31-a4f3-d062cbef0895-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:07:06.145937 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.145907    2558 generic.go:356] "Generic (PLEG): container finished" podID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" containerID="e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1" exitCode=0
Jul 10 23:07:06.146107 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.145954    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"
Jul 10 23:07:06.146107 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.146005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" event={"ID":"5db1f2a2-124d-4c31-a4f3-d062cbef0895","Type":"ContainerDied","Data":"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"}
Jul 10 23:07:06.146107 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.146059    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk" event={"ID":"5db1f2a2-124d-4c31-a4f3-d062cbef0895","Type":"ContainerDied","Data":"3635192db42408456f0af9d1776e427617debdc2a0697affe273cddbe65cb4e6"}
Jul 10 23:07:06.146107 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.146089    2558 scope.go:117] "RemoveContainer" containerID="e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"
Jul 10 23:07:06.155582 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.155565    2558 scope.go:117] "RemoveContainer" containerID="e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"
Jul 10 23:07:06.155892 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:07:06.155870    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1\": container with ID starting with e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1 not found: ID does not exist" containerID="e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"
Jul 10 23:07:06.155955 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.155904    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1"} err="failed to get container status \"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1\": rpc error: code = NotFound desc = could not find container \"e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1\": container with ID starting with e0af2dc626016b8cd9edab37333b0e25de777cde273cdf5303e74c3f2fae0eb1 not found: ID does not exist"
Jul 10 23:07:06.171220 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.171196    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:07:06.176248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.176226    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zvtdk"]
Jul 10 23:07:06.539371 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:06.539336    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" path="/var/lib/kubelet/pods/5db1f2a2-124d-4c31-a4f3-d062cbef0895/volumes"
Jul 10 23:07:09.416449 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416412    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"]
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416766    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" containerName="manager"
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416777    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" containerName="manager"
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416796    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" containerName="manager"
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416802    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" containerName="manager"
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416850    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3842ab43-f176-44cd-a6e5-9e22f39c8f27" containerName="manager"
Jul 10 23:07:09.416927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.416862    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5db1f2a2-124d-4c31-a4f3-d062cbef0895" containerName="manager"
Jul 10 23:07:09.955821 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.955789    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"]
Jul 10 23:07:09.956021 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.955931    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:09.958552 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:09.958531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xg7rp\""
Jul 10 23:07:10.034559 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034519    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2e3484-529b-4dac-85df-c7d15629f3df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034598    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2e3484-529b-4dac-85df-c7d15629f3df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034661    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlck6\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-kube-api-access-dlck6\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034723 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034890 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034890 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.034890 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.034843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.135965 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.135932    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2e3484-529b-4dac-85df-c7d15629f3df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.135971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.135988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlck6\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-kube-api-access-dlck6\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136007    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136159 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136574 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2e3484-529b-4dac-85df-c7d15629f3df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136574 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136398    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136574 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136558    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136744 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.136862 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.136814    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be2e3484-529b-4dac-85df-c7d15629f3df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.137080 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.137057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.138540 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.138492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be2e3484-529b-4dac-85df-c7d15629f3df-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.138800 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.138783    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be2e3484-529b-4dac-85df-c7d15629f3df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.144437 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.144411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.144437 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.144434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlck6\" (UniqueName: \"kubernetes.io/projected/be2e3484-529b-4dac-85df-c7d15629f3df-kube-api-access-dlck6\") pod \"maas-default-gateway-openshift-default-56654dcf7-qmv9t\" (UID: \"be2e3484-529b-4dac-85df-c7d15629f3df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.266467 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.266379    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:10.547524 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.547416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"]
Jul 10 23:07:10.550714 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:07:10.550688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2e3484_529b_4dac_85df_c7d15629f3df.slice/crio-7dcfdb48b43afb5893364ad858ec611fd1c6e2e34171bc4e3e68294c5e4a983a WatchSource:0}: Error finding container 7dcfdb48b43afb5893364ad858ec611fd1c6e2e34171bc4e3e68294c5e4a983a: Status 404 returned error can't find the container with id 7dcfdb48b43afb5893364ad858ec611fd1c6e2e34171bc4e3e68294c5e4a983a
Jul 10 23:07:10.553153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.553117    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:07:10.553216 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.553189    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:07:10.553260 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:10.553220    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:07:11.174237 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:11.174203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" event={"ID":"be2e3484-529b-4dac-85df-c7d15629f3df","Type":"ContainerStarted","Data":"ab28f938c695b4ae595e0d3cd776ca119df2cc4bc7239bacff5587edd8e91b52"}
Jul 10 23:07:11.174393 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:11.174254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" event={"ID":"be2e3484-529b-4dac-85df-c7d15629f3df","Type":"ContainerStarted","Data":"7dcfdb48b43afb5893364ad858ec611fd1c6e2e34171bc4e3e68294c5e4a983a"}
Jul 10 23:07:11.194460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:11.194412    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podStartSLOduration=2.194396682 podStartE2EDuration="2.194396682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:07:11.192256145 +0000 UTC m=+677.167811152" watchObservedRunningTime="2026-07-10 23:07:11.194396682 +0000 UTC m=+677.169951738"
Jul 10 23:07:11.266951 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:11.266921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:11.271680 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:11.271655    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:12.179169 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:12.179134    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:12.180136 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:12.180117    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:07:22.386263 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.386228    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:22.388668 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.388652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.390787 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.390768    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 23:07:22.398954 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.398927    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:22.439587 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.439554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.439751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.439643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrl59\" (UniqueName: \"kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.487257 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.487223    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:22.540421 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.540382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrl59\" (UniqueName: \"kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.540636 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.540459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.541117 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.541097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.547711 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.547683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrl59\" (UniqueName: \"kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59\") pod \"limitador-limitador-64c94fd64f-xhj7s\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.701130 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.701039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:22.836115 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:22.836077    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:22.838732 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:07:22.838706    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92744be4_0485_4e86_bac5_89ff96efcc96.slice/crio-8edc99e7f3c3d9480b2cb9025eac563783056f6968b5afc03c993154189530a6 WatchSource:0}: Error finding container 8edc99e7f3c3d9480b2cb9025eac563783056f6968b5afc03c993154189530a6: Status 404 returned error can't find the container with id 8edc99e7f3c3d9480b2cb9025eac563783056f6968b5afc03c993154189530a6
Jul 10 23:07:23.168565 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.168535    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:23.171810 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.171788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:23.173874 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.173854    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rkdp2\""
Jul 10 23:07:23.177880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.177849    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:23.239045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.239008    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" event={"ID":"92744be4-0485-4e86-bac5-89ff96efcc96","Type":"ContainerStarted","Data":"8edc99e7f3c3d9480b2cb9025eac563783056f6968b5afc03c993154189530a6"}
Jul 10 23:07:23.248486 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.248462    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxp7j\" (UniqueName: \"kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j\") pod \"authorino-58cd955675-6h74x\" (UID: \"afe00ca4-49de-433e-9bfa-068f7fd0cb7a\") " pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:23.349946 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.349903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxp7j\" (UniqueName: \"kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j\") pod \"authorino-58cd955675-6h74x\" (UID: \"afe00ca4-49de-433e-9bfa-068f7fd0cb7a\") " pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:23.366230 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.366199    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxp7j\" (UniqueName: \"kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j\") pod \"authorino-58cd955675-6h74x\" (UID: \"afe00ca4-49de-433e-9bfa-068f7fd0cb7a\") " pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:23.483188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.483110    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:23.663905 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:23.663839    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:24.247652 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:24.247612    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6h74x" event={"ID":"afe00ca4-49de-433e-9bfa-068f7fd0cb7a","Type":"ContainerStarted","Data":"e763fb05bd5c4a750413740b73bc2e2d2ba2c026a69ea7bc4138b9d1ce34ac2b"}
Jul 10 23:07:27.691211 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:27.691173    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:28.271786 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:28.271745    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" event={"ID":"92744be4-0485-4e86-bac5-89ff96efcc96","Type":"ContainerStarted","Data":"dbda8bc3a7ff74489665d6ac24b8aea1c74adece73030f92fdcdf4159b927334"}
Jul 10 23:07:28.271994 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:28.271821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:28.273120 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:28.273091    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6h74x" event={"ID":"afe00ca4-49de-433e-9bfa-068f7fd0cb7a","Type":"ContainerStarted","Data":"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"}
Jul 10 23:07:28.287789 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:28.287743    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" podStartSLOduration=1.6139138659999999 podStartE2EDuration="6.287728623s" totalImagesPullingTime="4.673814757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:07:28.285847049 +0000 UTC m=+694.261402050" watchObservedRunningTime="2026-07-10 23:07:28.287728623 +0000 UTC m=+694.263283624"
Jul 10 23:07:28.299133 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:28.299091    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6h74x" podStartSLOduration=1.45177734 podStartE2EDuration="5.299076514s" totalImagesPullingTime="3.847299174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:07:28.296960716 +0000 UTC m=+694.272515718" watchObservedRunningTime="2026-07-10 23:07:28.299076514 +0000 UTC m=+694.274631515"
Jul 10 23:07:29.278488 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:29.278438    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6h74x" podUID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" containerName="authorino" containerID="cri-o://770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0" gracePeriod=30
Jul 10 23:07:29.531149 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:29.531081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:29.606766 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:29.606720    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxp7j\" (UniqueName: \"kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j\") pod \"afe00ca4-49de-433e-9bfa-068f7fd0cb7a\" (UID: \"afe00ca4-49de-433e-9bfa-068f7fd0cb7a\") "
Jul 10 23:07:29.608923 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:29.608892    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j" (OuterVolumeSpecName: "kube-api-access-jxp7j") pod "afe00ca4-49de-433e-9bfa-068f7fd0cb7a" (UID: "afe00ca4-49de-433e-9bfa-068f7fd0cb7a"). InnerVolumeSpecName "kube-api-access-jxp7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:07:29.708320 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:29.708285    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxp7j\" (UniqueName: \"kubernetes.io/projected/afe00ca4-49de-433e-9bfa-068f7fd0cb7a-kube-api-access-jxp7j\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:07:30.284535 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.284465    2558 generic.go:356] "Generic (PLEG): container finished" podID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" containerID="770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0" exitCode=0
Jul 10 23:07:30.284535 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.284527    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6h74x"
Jul 10 23:07:30.285027 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.284556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6h74x" event={"ID":"afe00ca4-49de-433e-9bfa-068f7fd0cb7a","Type":"ContainerDied","Data":"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"}
Jul 10 23:07:30.285027 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.284594    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6h74x" event={"ID":"afe00ca4-49de-433e-9bfa-068f7fd0cb7a","Type":"ContainerDied","Data":"e763fb05bd5c4a750413740b73bc2e2d2ba2c026a69ea7bc4138b9d1ce34ac2b"}
Jul 10 23:07:30.285027 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.284613    2558 scope.go:117] "RemoveContainer" containerID="770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"
Jul 10 23:07:30.293941 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.293924    2558 scope.go:117] "RemoveContainer" containerID="770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"
Jul 10 23:07:30.294177 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:07:30.294160    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0\": container with ID starting with 770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0 not found: ID does not exist" containerID="770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"
Jul 10 23:07:30.294222 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.294185    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0"} err="failed to get container status \"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0\": rpc error: code = NotFound desc = could not find container \"770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0\": container with ID starting with 770f7f5d50d672e3888d4d66b3180d3f2b8d72ee547a2f14177a472b62ce4cb0 not found: ID does not exist"
Jul 10 23:07:30.305239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.305217    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:30.309028 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.309005    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6h74x"]
Jul 10 23:07:30.540209 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:30.540130    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" path="/var/lib/kubelet/pods/afe00ca4-49de-433e-9bfa-068f7fd0cb7a/volumes"
Jul 10 23:07:36.798476 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:36.798442    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:36.799007 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:36.798787    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" podUID="92744be4-0485-4e86-bac5-89ff96efcc96" containerName="limitador" containerID="cri-o://dbda8bc3a7ff74489665d6ac24b8aea1c74adece73030f92fdcdf4159b927334" gracePeriod=30
Jul 10 23:07:36.799587 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:36.799514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:37.325184 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.325151    2558 generic.go:356] "Generic (PLEG): container finished" podID="92744be4-0485-4e86-bac5-89ff96efcc96" containerID="dbda8bc3a7ff74489665d6ac24b8aea1c74adece73030f92fdcdf4159b927334" exitCode=0
Jul 10 23:07:37.325383 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.325224    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" event={"ID":"92744be4-0485-4e86-bac5-89ff96efcc96","Type":"ContainerDied","Data":"dbda8bc3a7ff74489665d6ac24b8aea1c74adece73030f92fdcdf4159b927334"}
Jul 10 23:07:37.355015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.354987    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:37.483830 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.483800    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrl59\" (UniqueName: \"kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59\") pod \"92744be4-0485-4e86-bac5-89ff96efcc96\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") "
Jul 10 23:07:37.484009 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.483896    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file\") pod \"92744be4-0485-4e86-bac5-89ff96efcc96\" (UID: \"92744be4-0485-4e86-bac5-89ff96efcc96\") "
Jul 10 23:07:37.484285 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.484263    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file" (OuterVolumeSpecName: "config-file") pod "92744be4-0485-4e86-bac5-89ff96efcc96" (UID: "92744be4-0485-4e86-bac5-89ff96efcc96"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:07:37.486064 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.486032    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59" (OuterVolumeSpecName: "kube-api-access-qrl59") pod "92744be4-0485-4e86-bac5-89ff96efcc96" (UID: "92744be4-0485-4e86-bac5-89ff96efcc96"). InnerVolumeSpecName "kube-api-access-qrl59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:07:37.584970 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.584929    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/92744be4-0485-4e86-bac5-89ff96efcc96-config-file\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:07:37.584970 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:37.584960    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrl59\" (UniqueName: \"kubernetes.io/projected/92744be4-0485-4e86-bac5-89ff96efcc96-kube-api-access-qrl59\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:07:38.331416 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.331386    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"
Jul 10 23:07:38.331881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.331429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xhj7s" event={"ID":"92744be4-0485-4e86-bac5-89ff96efcc96","Type":"ContainerDied","Data":"8edc99e7f3c3d9480b2cb9025eac563783056f6968b5afc03c993154189530a6"}
Jul 10 23:07:38.331881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.331493    2558 scope.go:117] "RemoveContainer" containerID="dbda8bc3a7ff74489665d6ac24b8aea1c74adece73030f92fdcdf4159b927334"
Jul 10 23:07:38.350859 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.350832    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:38.354519 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.354480    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xhj7s"]
Jul 10 23:07:38.541427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:38.541392    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92744be4-0485-4e86-bac5-89ff96efcc96" path="/var/lib/kubelet/pods/92744be4-0485-4e86-bac5-89ff96efcc96/volumes"
Jul 10 23:07:39.009269 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009230    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"]
Jul 10 23:07:39.009778 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009762    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92744be4-0485-4e86-bac5-89ff96efcc96" containerName="limitador"
Jul 10 23:07:39.009832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009782    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="92744be4-0485-4e86-bac5-89ff96efcc96" containerName="limitador"
Jul 10 23:07:39.009832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009794    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" containerName="authorino"
Jul 10 23:07:39.009832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009802    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" containerName="authorino"
Jul 10 23:07:39.009933 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009884    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="92744be4-0485-4e86-bac5-89ff96efcc96" containerName="limitador"
Jul 10 23:07:39.009933 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.009898    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe00ca4-49de-433e-9bfa-068f7fd0cb7a" containerName="authorino"
Jul 10 23:07:39.014220 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.014199    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.016820 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.016795    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 23:07:39.016940 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.016795    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5pdm4\""
Jul 10 23:07:39.017131 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.017102    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 23:07:39.017660 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.017639    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 23:07:39.021102 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.021083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"]
Jul 10 23:07:39.097920 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.097887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfgq4\" (UniqueName: \"kubernetes.io/projected/f80c5d41-536e-486c-af38-cab2b48e720c-kube-api-access-pfgq4\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.098102 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.097949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f80c5d41-536e-486c-af38-cab2b48e720c-data\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.198776 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.198732    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f80c5d41-536e-486c-af38-cab2b48e720c-data\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.198929 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.198810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfgq4\" (UniqueName: \"kubernetes.io/projected/f80c5d41-536e-486c-af38-cab2b48e720c-kube-api-access-pfgq4\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.199128 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.199109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f80c5d41-536e-486c-af38-cab2b48e720c-data\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.207105 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.207080    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfgq4\" (UniqueName: \"kubernetes.io/projected/f80c5d41-536e-486c-af38-cab2b48e720c-kube-api-access-pfgq4\") pod \"postgres-69fb4594cf-nzqdm\" (UID: \"f80c5d41-536e-486c-af38-cab2b48e720c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.326212 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.326121    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:39.462602 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:39.462576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"]
Jul 10 23:07:39.464835 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:07:39.464806    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80c5d41_536e_486c_af38_cab2b48e720c.slice/crio-e738933f11956f5923a90599ff40d24864627c21d84662ea65b5c5a08c163dd7 WatchSource:0}: Error finding container e738933f11956f5923a90599ff40d24864627c21d84662ea65b5c5a08c163dd7: Status 404 returned error can't find the container with id e738933f11956f5923a90599ff40d24864627c21d84662ea65b5c5a08c163dd7
Jul 10 23:07:40.356660 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:40.356619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm" event={"ID":"f80c5d41-536e-486c-af38-cab2b48e720c","Type":"ContainerStarted","Data":"e738933f11956f5923a90599ff40d24864627c21d84662ea65b5c5a08c163dd7"}
Jul 10 23:07:45.386078 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:45.385995    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm" event={"ID":"f80c5d41-536e-486c-af38-cab2b48e720c","Type":"ContainerStarted","Data":"ca17c4fe9fc3756b6bec462089516246909d7c2d88c9b5287a80ddccb469f74d"}
Jul 10 23:07:45.386556 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:45.386128    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:45.401425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:45.401363    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm" podStartSLOduration=2.5310244920000002 podStartE2EDuration="7.401340612s" totalImagesPullingTime="4.87031612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:07:45.400862559 +0000 UTC m=+711.376417562" watchObservedRunningTime="2026-07-10 23:07:45.401340612 +0000 UTC m=+711.376895618"
Jul 10 23:07:51.420777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:51.420750    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nzqdm"
Jul 10 23:07:58.160337 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.160304    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:07:58.297645 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.297606    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:07:58.297825 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.297744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.300603 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.300577    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 23:07:58.301719 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.301695    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kh9mw\""
Jul 10 23:07:58.301880 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.301726    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 23:07:58.333809 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.333774    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:07:58.348443 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.348416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:07:58.348589 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.348529    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.368633 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.368596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8p5\" (UniqueName: \"kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.368793 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.368749    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.368861 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.368792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.368920 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.368860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfcv\" (UniqueName: \"kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.470185 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.470099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfcv\" (UniqueName: \"kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.470185 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.470147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8p5\" (UniqueName: \"kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.470398 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.470199    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.470398 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.470221    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.472786 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.472761    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.472938 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.472915    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.478840 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.478804    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfcv\" (UniqueName: \"kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv\") pod \"maas-controller-7557f7b465-7rpdz\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") " pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.478953 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.478876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8p5\" (UniqueName: \"kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5\") pod \"maas-controller-86cc69d557-bdgj4\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") " pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.608743 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.608704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:07:58.659043 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.659014    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:07:58.788984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.788954    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:07:58.790621 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:07:58.790588    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e6068e5_64af_4124_9443_9e56cdbfd9c6.slice/crio-7ea3644e99428ca39e853b9a4cedcf70b763cb2cfeb06ad43a2402c30a5ceecd WatchSource:0}: Error finding container 7ea3644e99428ca39e853b9a4cedcf70b763cb2cfeb06ad43a2402c30a5ceecd: Status 404 returned error can't find the container with id 7ea3644e99428ca39e853b9a4cedcf70b763cb2cfeb06ad43a2402c30a5ceecd
Jul 10 23:07:58.815990 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:58.815967    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:07:58.817978 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:07:58.817952    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658aca0a_d08a_4d85_bfa1_af54552b0a73.slice/crio-ebbf9e05014b8aa06fe1a77caeb2def4d70e3b98970b4f97d3044117a8d25543 WatchSource:0}: Error finding container ebbf9e05014b8aa06fe1a77caeb2def4d70e3b98970b4f97d3044117a8d25543: Status 404 returned error can't find the container with id ebbf9e05014b8aa06fe1a77caeb2def4d70e3b98970b4f97d3044117a8d25543
Jul 10 23:07:59.461719 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:59.461678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7557f7b465-7rpdz" event={"ID":"9e6068e5-64af-4124-9443-9e56cdbfd9c6","Type":"ContainerStarted","Data":"7ea3644e99428ca39e853b9a4cedcf70b763cb2cfeb06ad43a2402c30a5ceecd"}
Jul 10 23:07:59.463447 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:07:59.463407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-bdgj4" event={"ID":"658aca0a-d08a-4d85-bfa1-af54552b0a73","Type":"ContainerStarted","Data":"ebbf9e05014b8aa06fe1a77caeb2def4d70e3b98970b4f97d3044117a8d25543"}
Jul 10 23:08:02.481302 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.481261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-bdgj4" event={"ID":"658aca0a-d08a-4d85-bfa1-af54552b0a73","Type":"ContainerStarted","Data":"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"}
Jul 10 23:08:02.481808 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.481334    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:08:02.482768 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.482746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7557f7b465-7rpdz" event={"ID":"9e6068e5-64af-4124-9443-9e56cdbfd9c6","Type":"ContainerStarted","Data":"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"}
Jul 10 23:08:02.482879 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.482866    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:08:02.501056 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.501010    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86cc69d557-bdgj4" podStartSLOduration=1.810395737 podStartE2EDuration="4.500992064s" totalImagesPullingTime="2.690596327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:08:02.500075905 +0000 UTC m=+728.475630901" watchObservedRunningTime="2026-07-10 23:08:02.500992064 +0000 UTC m=+728.476547044"
Jul 10 23:08:02.515978 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:02.515924    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7557f7b465-7rpdz" podStartSLOduration=1.808603159 podStartE2EDuration="4.51590702s" totalImagesPullingTime="2.707303861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:08:02.514814636 +0000 UTC m=+728.490369642" watchObservedRunningTime="2026-07-10 23:08:02.51590702 +0000 UTC m=+728.491462022"
Jul 10 23:08:13.494398 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.494363    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:08:13.494796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.494442    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:08:13.556124 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.556084    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:08:13.556302 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.556261    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7557f7b465-7rpdz" podUID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" containerName="manager" containerID="cri-o://f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e" gracePeriod=30
Jul 10 23:08:13.808865 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.808838    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:08:13.910671 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.910635    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncfcv\" (UniqueName: \"kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv\") pod \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") "
Jul 10 23:08:13.910876 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.910706    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert\") pod \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\" (UID: \"9e6068e5-64af-4124-9443-9e56cdbfd9c6\") "
Jul 10 23:08:13.913118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.913087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e6068e5-64af-4124-9443-9e56cdbfd9c6" (UID: "9e6068e5-64af-4124-9443-9e56cdbfd9c6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:08:13.913118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:13.913095    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv" (OuterVolumeSpecName: "kube-api-access-ncfcv") pod "9e6068e5-64af-4124-9443-9e56cdbfd9c6" (UID: "9e6068e5-64af-4124-9443-9e56cdbfd9c6"). InnerVolumeSpecName "kube-api-access-ncfcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:08:14.011459 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.011422    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e6068e5-64af-4124-9443-9e56cdbfd9c6-webhook-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:08:14.011459 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.011451    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncfcv\" (UniqueName: \"kubernetes.io/projected/9e6068e5-64af-4124-9443-9e56cdbfd9c6-kube-api-access-ncfcv\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:08:14.546463 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.546424    2558 generic.go:356] "Generic (PLEG): container finished" podID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" containerID="f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e" exitCode=0
Jul 10 23:08:14.546924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.546474    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7557f7b465-7rpdz"
Jul 10 23:08:14.546924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.546523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7557f7b465-7rpdz" event={"ID":"9e6068e5-64af-4124-9443-9e56cdbfd9c6","Type":"ContainerDied","Data":"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"}
Jul 10 23:08:14.546924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.546574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7557f7b465-7rpdz" event={"ID":"9e6068e5-64af-4124-9443-9e56cdbfd9c6","Type":"ContainerDied","Data":"7ea3644e99428ca39e853b9a4cedcf70b763cb2cfeb06ad43a2402c30a5ceecd"}
Jul 10 23:08:14.546924 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.546595    2558 scope.go:117] "RemoveContainer" containerID="f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"
Jul 10 23:08:14.556030 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.556010    2558 scope.go:117] "RemoveContainer" containerID="f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"
Jul 10 23:08:14.556315 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:08:14.556297    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e\": container with ID starting with f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e not found: ID does not exist" containerID="f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"
Jul 10 23:08:14.556361 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.556324    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e"} err="failed to get container status \"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e\": rpc error: code = NotFound desc = could not find container \"f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e\": container with ID starting with f36a81e8c99e7000e152dc8631f0b9f1f509fc082f4d6c051cc34ec34933510e not found: ID does not exist"
Jul 10 23:08:14.567624 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.567603    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:08:14.570982 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:14.570961    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7557f7b465-7rpdz"]
Jul 10 23:08:16.540131 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:16.540090    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" path="/var/lib/kubelet/pods/9e6068e5-64af-4124-9443-9e56cdbfd9c6/volumes"
Jul 10 23:08:34.626777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.626745    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"]
Jul 10 23:08:34.627189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.627080    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" containerName="manager"
Jul 10 23:08:34.627189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.627090    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" containerName="manager"
Jul 10 23:08:34.627189 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.627164    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e6068e5-64af-4124-9443-9e56cdbfd9c6" containerName="manager"
Jul 10 23:08:34.632089 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.632069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.634687 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.634581    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fxg5k\""
Jul 10 23:08:34.634843 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.634826    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 23:08:34.640849 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.640822    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"]
Jul 10 23:08:34.701404 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.701359    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.701404 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.701404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-openshift-service-ca\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.701666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.701571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nvc7\" (UniqueName: \"kubernetes.io/projected/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-kube-api-access-5nvc7\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.802312 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.802272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nvc7\" (UniqueName: \"kubernetes.io/projected/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-kube-api-access-5nvc7\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.802559 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.802323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.802559 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.802346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-openshift-service-ca\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.802559 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:08:34.802455    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 10 23:08:34.802559 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:08:34.802562    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls podName:7c2bb2cc-8e55-40f1-b329-8116f5fa8977 nodeName:}" failed. No retries permitted until 2026-07-10 23:08:35.302543176 +0000 UTC m=+761.278098157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls") pod "maas-api-85cc7c6cfb-nn826" (UID: "7c2bb2cc-8e55-40f1-b329-8116f5fa8977") : secret "maas-api-serving-cert" not found
Jul 10 23:08:34.803069 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.803051    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-openshift-service-ca\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:34.811055 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:34.811029    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nvc7\" (UniqueName: \"kubernetes.io/projected/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-kube-api-access-5nvc7\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:35.105121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.105080    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-49f96"]
Jul 10 23:08:35.108767 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.108749    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.110992 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.110970    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 23:08:35.120520 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.119418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-49f96"]
Jul 10 23:08:35.160309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.160281    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"]
Jul 10 23:08:35.163720 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.163698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.165867 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.165848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2lqmv\""
Jul 10 23:08:35.174784 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.174761    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"]
Jul 10 23:08:35.206214 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.206183    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933ee89a-c40f-46ad-ba82-318295f6a2ae-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.206401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.206219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w65x5\" (UniqueName: \"kubernetes.io/projected/933ee89a-c40f-46ad-ba82-318295f6a2ae-kube-api-access-w65x5\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.206401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.206252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e53fb6ae-e83d-4150-b471-732410b13d71-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.206401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.206312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmd4\" (UniqueName: \"kubernetes.io/projected/e53fb6ae-e83d-4150-b471-732410b13d71-kube-api-access-fjmd4\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.306933 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.306901    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:35.307126 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.306952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933ee89a-c40f-46ad-ba82-318295f6a2ae-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.307197 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.307135    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w65x5\" (UniqueName: \"kubernetes.io/projected/933ee89a-c40f-46ad-ba82-318295f6a2ae-kube-api-access-w65x5\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.307197 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.307190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e53fb6ae-e83d-4150-b471-732410b13d71-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.307303 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.307217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmd4\" (UniqueName: \"kubernetes.io/projected/e53fb6ae-e83d-4150-b471-732410b13d71-kube-api-access-fjmd4\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.307798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.307777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/933ee89a-c40f-46ad-ba82-318295f6a2ae-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.307993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.307972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e53fb6ae-e83d-4150-b471-732410b13d71-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.309635 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.309611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c2bb2cc-8e55-40f1-b329-8116f5fa8977-maas-api-tls\") pod \"maas-api-85cc7c6cfb-nn826\" (UID: \"7c2bb2cc-8e55-40f1-b329-8116f5fa8977\") " pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:35.314300 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.314274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w65x5\" (UniqueName: \"kubernetes.io/projected/933ee89a-c40f-46ad-ba82-318295f6a2ae-kube-api-access-w65x5\") pod \"payload-processing-f9b8d9b9b-rtjsk\" (UID: \"933ee89a-c40f-46ad-ba82-318295f6a2ae\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.314555 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.314393    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmd4\" (UniqueName: \"kubernetes.io/projected/e53fb6ae-e83d-4150-b471-732410b13d71-kube-api-access-fjmd4\") pod \"payload-pre-processing-74584bb9f8-49f96\" (UID: \"e53fb6ae-e83d-4150-b471-732410b13d71\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.422216 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.422172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:35.475569 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.475539    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:35.543846 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.543563    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:35.576976 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.576947    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-49f96"]
Jul 10 23:08:35.577822 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:08:35.577789    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53fb6ae_e83d_4150_b471_732410b13d71.slice/crio-c5cb35a0777386642bbcd642f394faf8eed5071f5b6942146c5ecb46509a70ae WatchSource:0}: Error finding container c5cb35a0777386642bbcd642f394faf8eed5071f5b6942146c5ecb46509a70ae: Status 404 returned error can't find the container with id c5cb35a0777386642bbcd642f394faf8eed5071f5b6942146c5ecb46509a70ae
Jul 10 23:08:35.636904 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.636827    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"]
Jul 10 23:08:35.638730 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:08:35.638702    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933ee89a_c40f_46ad_ba82_318295f6a2ae.slice/crio-3cfbba260d8b1a56dfc1df89cd04a51671e32d9fb304a26aa5f00e4122f2ca8a WatchSource:0}: Error finding container 3cfbba260d8b1a56dfc1df89cd04a51671e32d9fb304a26aa5f00e4122f2ca8a: Status 404 returned error can't find the container with id 3cfbba260d8b1a56dfc1df89cd04a51671e32d9fb304a26aa5f00e4122f2ca8a
Jul 10 23:08:35.653089 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.653051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk" event={"ID":"933ee89a-c40f-46ad-ba82-318295f6a2ae","Type":"ContainerStarted","Data":"3cfbba260d8b1a56dfc1df89cd04a51671e32d9fb304a26aa5f00e4122f2ca8a"}
Jul 10 23:08:35.654644 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.654616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96" event={"ID":"e53fb6ae-e83d-4150-b471-732410b13d71","Type":"ContainerStarted","Data":"c5cb35a0777386642bbcd642f394faf8eed5071f5b6942146c5ecb46509a70ae"}
Jul 10 23:08:35.698196 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:35.698166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"]
Jul 10 23:08:35.700809 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:08:35.700779    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2bb2cc_8e55_40f1_b329_8116f5fa8977.slice/crio-a555e45d460292f3732e368f9fda4043e3c6c0db688705059d17f181046c45c1 WatchSource:0}: Error finding container a555e45d460292f3732e368f9fda4043e3c6c0db688705059d17f181046c45c1: Status 404 returned error can't find the container with id a555e45d460292f3732e368f9fda4043e3c6c0db688705059d17f181046c45c1
Jul 10 23:08:36.676849 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:36.676748    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826" event={"ID":"7c2bb2cc-8e55-40f1-b329-8116f5fa8977","Type":"ContainerStarted","Data":"a555e45d460292f3732e368f9fda4043e3c6c0db688705059d17f181046c45c1"}
Jul 10 23:08:38.704557 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.704513    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96" event={"ID":"e53fb6ae-e83d-4150-b471-732410b13d71","Type":"ContainerStarted","Data":"8435386f834f4fb1e5050c5d753fd9069508f851419216f52246261f13810203"}
Jul 10 23:08:38.704991 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.704608    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:08:38.706182 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.706148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826" event={"ID":"7c2bb2cc-8e55-40f1-b329-8116f5fa8977","Type":"ContainerStarted","Data":"535f02489d28a3cf9c2120e09133c50778c53f1d6b90c75dca2a96dd459e15da"}
Jul 10 23:08:38.706309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.706207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:38.707715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.707691    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk" event={"ID":"933ee89a-c40f-46ad-ba82-318295f6a2ae","Type":"ContainerStarted","Data":"43f43f442c271ac9190df5467a3c72661021821b11e74d29ee6b2154764e0560"}
Jul 10 23:08:38.707838 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.707809    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:38.722464 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.722410    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96" podStartSLOduration=1.596576159 podStartE2EDuration="3.72239013s" totalImagesPullingTime="2.125813971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:08:38.719375904 +0000 UTC m=+764.694930905" watchObservedRunningTime="2026-07-10 23:08:38.72239013 +0000 UTC m=+764.697945133"
Jul 10 23:08:38.736135 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.736081    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826" podStartSLOduration=2.732192983 podStartE2EDuration="4.736066345s" totalImagesPullingTime="2.003873362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:08:38.734373156 +0000 UTC m=+764.709928182" watchObservedRunningTime="2026-07-10 23:08:38.736066345 +0000 UTC m=+764.711621347"
Jul 10 23:08:38.749343 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:38.749298    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk" podStartSLOduration=1.681747599 podStartE2EDuration="3.74928129s" totalImagesPullingTime="2.067533691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:08:38.74736603 +0000 UTC m=+764.722921037" watchObservedRunningTime="2026-07-10 23:08:38.74928129 +0000 UTC m=+764.724836336"
Jul 10 23:08:42.822423 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:42.822386    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qmv9t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:46298->10.134.0.41:15021: read: connection reset by peer" start-of-body=
Jul 10 23:08:42.822874 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:42.822474    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podUID="be2e3484-529b-4dac-85df-c7d15629f3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:46298->10.134.0.41:15021: read: connection reset by peer"
Jul 10 23:08:43.734600 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.734566    2558 generic.go:356] "Generic (PLEG): container finished" podID="be2e3484-529b-4dac-85df-c7d15629f3df" containerID="ab28f938c695b4ae595e0d3cd776ca119df2cc4bc7239bacff5587edd8e91b52" exitCode=0
Jul 10 23:08:43.734770 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.734643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" event={"ID":"be2e3484-529b-4dac-85df-c7d15629f3df","Type":"ContainerDied","Data":"ab28f938c695b4ae595e0d3cd776ca119df2cc4bc7239bacff5587edd8e91b52"}
Jul 10 23:08:43.735038 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.735025    2558 scope.go:117] "RemoveContainer" containerID="ab28f938c695b4ae595e0d3cd776ca119df2cc4bc7239bacff5587edd8e91b52"
Jul 10 23:08:43.736019 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.735993    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:08:43.736082 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.736059    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:08:43.736127 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:43.736100    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:08:44.719362 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:44.719333    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85cc7c6cfb-nn826"
Jul 10 23:08:44.742789 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:44.742749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" event={"ID":"be2e3484-529b-4dac-85df-c7d15629f3df","Type":"ContainerStarted","Data":"15169392c872eacd45d9045bb6ca44d4e810d63dbc0b79b6c8d68a1ed4a79a53"}
Jul 10 23:08:45.266734 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:45.266693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:08:45.267056 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:45.267022    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qmv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 10 23:08:45.267265 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:45.267238    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podUID="be2e3484-529b-4dac-85df-c7d15629f3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 10 23:08:46.267788 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:46.267752    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qmv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 10 23:08:46.268838 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:46.268390    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podUID="be2e3484-529b-4dac-85df-c7d15629f3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 10 23:08:47.267587 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:47.267545    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qmv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 10 23:08:47.267798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:47.267640    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podUID="be2e3484-529b-4dac-85df-c7d15629f3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 10 23:08:48.267481 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:48.267439    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-qmv9t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 10 23:08:48.267983 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:48.267530    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t" podUID="be2e3484-529b-4dac-85df-c7d15629f3df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 10 23:08:49.271109 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:49.271080    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:08:49.271541 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:49.271358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:08:49.272144 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:49.272124    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-qmv9t"
Jul 10 23:08:49.715551 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:49.715516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-rtjsk"
Jul 10 23:08:49.715761 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:08:49.715602    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-49f96"
Jul 10 23:09:06.112714 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.112677    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"]
Jul 10 23:09:06.118043 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.118009    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.120694 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.120671    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 23:09:06.120823 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.120695    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 23:09:06.121602 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.121582    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9b85h\""
Jul 10 23:09:06.121671 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.121618    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 10 23:09:06.124986 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.124961    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"]
Jul 10 23:09:06.293612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293573    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.293788 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.293788 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.293788 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5xr\" (UniqueName: \"kubernetes.io/projected/4b6088a2-8b28-4261-a9e1-ea8953c480ce-kube-api-access-4l5xr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.293896 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.293896 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.293817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394705 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5xr\" (UniqueName: \"kubernetes.io/projected/4b6088a2-8b28-4261-a9e1-ea8953c480ce-kube-api-access-4l5xr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.394881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.394856    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.395144 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.395123    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.395235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.395212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.395349 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.395300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.397208 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.397177    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6088a2-8b28-4261-a9e1-ea8953c480ce-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.397341 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.397284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6088a2-8b28-4261-a9e1-ea8953c480ce-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.402262 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.402235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5xr\" (UniqueName: \"kubernetes.io/projected/4b6088a2-8b28-4261-a9e1-ea8953c480ce-kube-api-access-4l5xr\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mjm6q\" (UID: \"4b6088a2-8b28-4261-a9e1-ea8953c480ce\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.430023 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.429991    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:06.586001 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.585955    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"]
Jul 10 23:09:06.860367 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:06.860265    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q" event={"ID":"4b6088a2-8b28-4261-a9e1-ea8953c480ce","Type":"ContainerStarted","Data":"83c5b04c6609be216feca57ebe36a064927d0fcd90045c3442628375b272de75"}
Jul 10 23:09:07.868711 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:07.868671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q" event={"ID":"4b6088a2-8b28-4261-a9e1-ea8953c480ce","Type":"ContainerStarted","Data":"bc1e3ec07e3e4bc5ba613db464d120b2ee80d02e4c91fcdb5a06ea2d999db6a9"}
Jul 10 23:09:07.891011 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:07.890952    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q" podStartSLOduration=0.789832418 podStartE2EDuration="1.890931808s" totalImagesPullingTime="1.10109939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:09:07.888640079 +0000 UTC m=+793.864195096" watchObservedRunningTime="2026-07-10 23:09:07.890931808 +0000 UTC m=+793.866486809"
Jul 10 23:09:16.430566 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:16.430473    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:16.430566 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:16.430557    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:16.442859 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:16.442837    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:16.926427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:16.926401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mjm6q"
Jul 10 23:09:37.717684 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.717642    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"]
Jul 10 23:09:37.721565 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.721540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.723835 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.723805    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 10 23:09:37.731646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.731626    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"]
Jul 10 23:09:37.770028 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.769987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.770028 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.770024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.770239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.770048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.770239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.770117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsr2d\" (UniqueName: \"kubernetes.io/projected/23ed38fb-22ce-47e3-ad2f-8adb6280f622-kube-api-access-zsr2d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.770239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.770149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.770239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.770229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871687 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871687 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871956 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871956 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsr2d\" (UniqueName: \"kubernetes.io/projected/23ed38fb-22ce-47e3-ad2f-8adb6280f622-kube-api-access-zsr2d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871956 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.871956 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.871835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.872197 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.872174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.872254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.872230    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.872301 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.872263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.874225 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.874201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23ed38fb-22ce-47e3-ad2f-8adb6280f622-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.874477 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.874458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23ed38fb-22ce-47e3-ad2f-8adb6280f622-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:37.879377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:37.879350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsr2d\" (UniqueName: \"kubernetes.io/projected/23ed38fb-22ce-47e3-ad2f-8adb6280f622-kube-api-access-zsr2d\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q\" (UID: \"23ed38fb-22ce-47e3-ad2f-8adb6280f622\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:38.032459 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:38.032370    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:38.175229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:38.174989    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"]
Jul 10 23:09:38.178492 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:09:38.178467    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ed38fb_22ce_47e3_ad2f_8adb6280f622.slice/crio-cf55b563fd9279cf3364479347069ada0e530d7962e83650ae98beed843de713 WatchSource:0}: Error finding container cf55b563fd9279cf3364479347069ada0e530d7962e83650ae98beed843de713: Status 404 returned error can't find the container with id cf55b563fd9279cf3364479347069ada0e530d7962e83650ae98beed843de713
Jul 10 23:09:39.027860 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:39.027823    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q" event={"ID":"23ed38fb-22ce-47e3-ad2f-8adb6280f622","Type":"ContainerStarted","Data":"4bc938cde4ba1251a3a68afb50aab7554b239d3bff9170fa8a28391917b7521b"}
Jul 10 23:09:39.028265 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:39.027876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q" event={"ID":"23ed38fb-22ce-47e3-ad2f-8adb6280f622","Type":"ContainerStarted","Data":"cf55b563fd9279cf3364479347069ada0e530d7962e83650ae98beed843de713"}
Jul 10 23:09:39.045202 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:39.045147    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q" podStartSLOduration=1.814517859 podStartE2EDuration="2.045130925s" totalImagesPullingTime="230.613066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:09:39.043205675 +0000 UTC m=+825.018760674" watchObservedRunningTime="2026-07-10 23:09:39.045130925 +0000 UTC m=+825.020685926"
Jul 10 23:09:43.717041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.717002    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"]
Jul 10 23:09:43.722631 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.722607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.725706 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.725679    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 10 23:09:43.727612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.727578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"]
Jul 10 23:09:43.826914 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.826878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.827080 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.826936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.827080 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.827001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.827080 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.827070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.827208 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.827116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.827208 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.827136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw9dm\" (UniqueName: \"kubernetes.io/projected/54e3642e-9bf6-492d-8d01-bfb3502a29f7-kube-api-access-bw9dm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928460 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw9dm\" (UniqueName: \"kubernetes.io/projected/54e3642e-9bf6-492d-8d01-bfb3502a29f7-kube-api-access-bw9dm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.928736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928714    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.929015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.928991    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.929083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.929040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.929290 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.929269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.930980 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.930952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54e3642e-9bf6-492d-8d01-bfb3502a29f7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.931365 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.931337    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54e3642e-9bf6-492d-8d01-bfb3502a29f7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:43.936833 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:43.936805    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw9dm\" (UniqueName: \"kubernetes.io/projected/54e3642e-9bf6-492d-8d01-bfb3502a29f7-kube-api-access-bw9dm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kt5c\" (UID: \"54e3642e-9bf6-492d-8d01-bfb3502a29f7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:44.035604 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:44.035481    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:44.178275 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:44.178237    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"]
Jul 10 23:09:44.182079 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:09:44.182050    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e3642e_9bf6_492d_8d01_bfb3502a29f7.slice/crio-f4abcce35b11afc66b28d6d1f512dff19bb9d31c4ba6d090033184aca3b7a5bf WatchSource:0}: Error finding container f4abcce35b11afc66b28d6d1f512dff19bb9d31c4ba6d090033184aca3b7a5bf: Status 404 returned error can't find the container with id f4abcce35b11afc66b28d6d1f512dff19bb9d31c4ba6d090033184aca3b7a5bf
Jul 10 23:09:45.060955 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:45.060914    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c" event={"ID":"54e3642e-9bf6-492d-8d01-bfb3502a29f7","Type":"ContainerStarted","Data":"bd4c2e14aa04496614f8f0eb771fe604ed7760c5a4ea0f009e3639260adf267c"}
Jul 10 23:09:45.061361 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:45.060984    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c" event={"ID":"54e3642e-9bf6-492d-8d01-bfb3502a29f7","Type":"ContainerStarted","Data":"f4abcce35b11afc66b28d6d1f512dff19bb9d31c4ba6d090033184aca3b7a5bf"}
Jul 10 23:09:45.079455 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:45.079403    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c" podStartSLOduration=1.900814291 podStartE2EDuration="2.079386717s" totalImagesPullingTime="178.572426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:09:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:09:45.077152337 +0000 UTC m=+831.052707340" watchObservedRunningTime="2026-07-10 23:09:45.079386717 +0000 UTC m=+831.054941718"
Jul 10 23:09:48.032634 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:48.032583    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:48.033139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:48.032662    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:48.045214 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:48.045182    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:48.090329 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:48.090300    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q"
Jul 10 23:09:54.035869 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:54.035827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:54.036473 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:54.035901    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:54.048332 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:54.048303    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:09:54.121439 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:09:54.121404    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kt5c"
Jul 10 23:10:54.772467 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:10:54.772386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:10:54.772993 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:10:54.772749    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:12:55.468638 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.468606    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:12:55.469208 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.468811    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86cc69d557-bdgj4" podUID="658aca0a-d08a-4d85-bfa1-af54552b0a73" containerName="manager" containerID="cri-o://cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec" gracePeriod=30
Jul 10 23:12:55.727832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.727770    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:12:55.811979 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.811943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert\") pod \"658aca0a-d08a-4d85-bfa1-af54552b0a73\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") "
Jul 10 23:12:55.812161 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.812056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm8p5\" (UniqueName: \"kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5\") pod \"658aca0a-d08a-4d85-bfa1-af54552b0a73\" (UID: \"658aca0a-d08a-4d85-bfa1-af54552b0a73\") "
Jul 10 23:12:55.814134 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.814108    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "658aca0a-d08a-4d85-bfa1-af54552b0a73" (UID: "658aca0a-d08a-4d85-bfa1-af54552b0a73"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:12:55.814248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.814160    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5" (OuterVolumeSpecName: "kube-api-access-bm8p5") pod "658aca0a-d08a-4d85-bfa1-af54552b0a73" (UID: "658aca0a-d08a-4d85-bfa1-af54552b0a73"). InnerVolumeSpecName "kube-api-access-bm8p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:12:55.912732 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.912696    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/658aca0a-d08a-4d85-bfa1-af54552b0a73-webhook-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:12:55.912732 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:55.912725    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm8p5\" (UniqueName: \"kubernetes.io/projected/658aca0a-d08a-4d85-bfa1-af54552b0a73-kube-api-access-bm8p5\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:12:56.068001 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.067913    2558 generic.go:356] "Generic (PLEG): container finished" podID="658aca0a-d08a-4d85-bfa1-af54552b0a73" containerID="cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec" exitCode=0
Jul 10 23:12:56.068001 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.067971    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-bdgj4"
Jul 10 23:12:56.068001 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.067978    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-bdgj4" event={"ID":"658aca0a-d08a-4d85-bfa1-af54552b0a73","Type":"ContainerDied","Data":"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"}
Jul 10 23:12:56.068275 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.068020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-bdgj4" event={"ID":"658aca0a-d08a-4d85-bfa1-af54552b0a73","Type":"ContainerDied","Data":"ebbf9e05014b8aa06fe1a77caeb2def4d70e3b98970b4f97d3044117a8d25543"}
Jul 10 23:12:56.068275 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.068049    2558 scope.go:117] "RemoveContainer" containerID="cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"
Jul 10 23:12:56.077242 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.077212    2558 scope.go:117] "RemoveContainer" containerID="cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"
Jul 10 23:12:56.077811 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:12:56.077557    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec\": container with ID starting with cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec not found: ID does not exist" containerID="cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"
Jul 10 23:12:56.077811 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.077594    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec"} err="failed to get container status \"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec\": rpc error: code = NotFound desc = could not find container \"cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec\": container with ID starting with cd447aa4d595dc7270376d2f52571ee6b5b00bedba934aed098461f0a7b845ec not found: ID does not exist"
Jul 10 23:12:56.091341 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.091316    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:12:56.093381 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.093362    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86cc69d557-bdgj4"]
Jul 10 23:12:56.540646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.540612    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="658aca0a-d08a-4d85-bfa1-af54552b0a73" path="/var/lib/kubelet/pods/658aca0a-d08a-4d85-bfa1-af54552b0a73/volumes"
Jul 10 23:12:56.916582 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.916554    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86cc69d557-vxrbm"]
Jul 10 23:12:56.916940 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.916928    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="658aca0a-d08a-4d85-bfa1-af54552b0a73" containerName="manager"
Jul 10 23:12:56.916998 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.916941    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="658aca0a-d08a-4d85-bfa1-af54552b0a73" containerName="manager"
Jul 10 23:12:56.916998 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.916997    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="658aca0a-d08a-4d85-bfa1-af54552b0a73" containerName="manager"
Jul 10 23:12:56.921031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.921013    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:56.923245 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.923223    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 23:12:56.924309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.924284    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kh9mw\""
Jul 10 23:12:56.924546 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.924531    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 23:12:56.927457 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:56.927406    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86cc69d557-vxrbm"]
Jul 10 23:12:57.027175 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.027125    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c36620-b174-4854-b486-8f39a8a6d772-webhook-cert\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.027347 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.027211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxp5d\" (UniqueName: \"kubernetes.io/projected/25c36620-b174-4854-b486-8f39a8a6d772-kube-api-access-hxp5d\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.128613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.128576    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c36620-b174-4854-b486-8f39a8a6d772-webhook-cert\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.128800 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.128634    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxp5d\" (UniqueName: \"kubernetes.io/projected/25c36620-b174-4854-b486-8f39a8a6d772-kube-api-access-hxp5d\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.131252 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.131227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/25c36620-b174-4854-b486-8f39a8a6d772-webhook-cert\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.136343 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.136312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxp5d\" (UniqueName: \"kubernetes.io/projected/25c36620-b174-4854-b486-8f39a8a6d772-kube-api-access-hxp5d\") pod \"maas-controller-86cc69d557-vxrbm\" (UID: \"25c36620-b174-4854-b486-8f39a8a6d772\") " pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.233858 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.233763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:57.374445 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.374422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86cc69d557-vxrbm"]
Jul 10 23:12:57.376384 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:12:57.376349    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25c36620_b174_4854_b486_8f39a8a6d772.slice/crio-386da0fb5caace50ba1cffa58feefde8e4a3c45963b460ee70c5b3ad4d6b5b77 WatchSource:0}: Error finding container 386da0fb5caace50ba1cffa58feefde8e4a3c45963b460ee70c5b3ad4d6b5b77: Status 404 returned error can't find the container with id 386da0fb5caace50ba1cffa58feefde8e4a3c45963b460ee70c5b3ad4d6b5b77
Jul 10 23:12:57.377927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:57.377909    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:12:58.082121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:58.082017    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-vxrbm" event={"ID":"25c36620-b174-4854-b486-8f39a8a6d772","Type":"ContainerStarted","Data":"eaba0770a038e3ee9bacdb6ff7d439ce94c80e0f18faf85bf4fdc44453ef4956"}
Jul 10 23:12:58.082121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:58.082082    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:12:58.082121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:58.082097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86cc69d557-vxrbm" event={"ID":"25c36620-b174-4854-b486-8f39a8a6d772","Type":"ContainerStarted","Data":"386da0fb5caace50ba1cffa58feefde8e4a3c45963b460ee70c5b3ad4d6b5b77"}
Jul 10 23:12:58.100711 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:12:58.100666    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86cc69d557-vxrbm" podStartSLOduration=1.6846987709999999 podStartE2EDuration="2.100651572s" totalImagesPullingTime="415.952801ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:12:58.098141249 +0000 UTC m=+1024.073696251" watchObservedRunningTime="2026-07-10 23:12:58.100651572 +0000 UTC m=+1024.076206601"
Jul 10 23:13:09.092379 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:13:09.092345    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86cc69d557-vxrbm"
Jul 10 23:15:54.810619 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:15:54.810590    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:15:54.812405 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:15:54.812384    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:17:38.634999 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:38.634952    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:17:38.635580 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:38.635195    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" podUID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" containerName="manager" containerID="cri-o://821ee13b1867fa9463f0801d42f8a174b9fc9931449f643d8b9a97242b96ee5d" gracePeriod=10
Jul 10 23:17:41.569044 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:41.569009    2558 generic.go:356] "Generic (PLEG): container finished" podID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" containerID="821ee13b1867fa9463f0801d42f8a174b9fc9931449f643d8b9a97242b96ee5d" exitCode=0
Jul 10 23:17:41.569421 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:41.569087    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" event={"ID":"ba864cb4-fb27-463b-96d6-7e27ced43ef9","Type":"ContainerDied","Data":"821ee13b1867fa9463f0801d42f8a174b9fc9931449f643d8b9a97242b96ee5d"}
Jul 10 23:17:41.999700 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:41.999675    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:17:42.103736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.103639    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume\") pod \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") "
Jul 10 23:17:42.103736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.103728    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8mc\" (UniqueName: \"kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc\") pod \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\" (UID: \"ba864cb4-fb27-463b-96d6-7e27ced43ef9\") "
Jul 10 23:17:42.104026 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.104002    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ba864cb4-fb27-463b-96d6-7e27ced43ef9" (UID: "ba864cb4-fb27-463b-96d6-7e27ced43ef9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:17:42.105981 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.105951    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc" (OuterVolumeSpecName: "kube-api-access-cb8mc") pod "ba864cb4-fb27-463b-96d6-7e27ced43ef9" (UID: "ba864cb4-fb27-463b-96d6-7e27ced43ef9"). InnerVolumeSpecName "kube-api-access-cb8mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:17:42.204737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.204706    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba864cb4-fb27-463b-96d6-7e27ced43ef9-extensions-socket-volume\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:17:42.204737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.204732    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8mc\" (UniqueName: \"kubernetes.io/projected/ba864cb4-fb27-463b-96d6-7e27ced43ef9-kube-api-access-cb8mc\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:17:42.575690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.575655    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"
Jul 10 23:17:42.576128 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.575652    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb" event={"ID":"ba864cb4-fb27-463b-96d6-7e27ced43ef9","Type":"ContainerDied","Data":"a76a319d086fa6e6b5e3c804b95c5e006184196140ace6192ec8a13fa67381e5"}
Jul 10 23:17:42.576128 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.575807    2558 scope.go:117] "RemoveContainer" containerID="821ee13b1867fa9463f0801d42f8a174b9fc9931449f643d8b9a97242b96ee5d"
Jul 10 23:17:42.594720 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.594689    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:17:42.598220 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:42.598194    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mjlsb"]
Jul 10 23:17:44.540572 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:17:44.540540    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" path="/var/lib/kubelet/pods/ba864cb4-fb27-463b-96d6-7e27ced43ef9/volumes"
Jul 10 23:18:39.790048 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.789957    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"]
Jul 10 23:18:39.790929 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.790529    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" containerName="manager"
Jul 10 23:18:39.790929 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.790549    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" containerName="manager"
Jul 10 23:18:39.790929 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.790674    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba864cb4-fb27-463b-96d6-7e27ced43ef9" containerName="manager"
Jul 10 23:18:39.793828 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.793806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:39.796201 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.796180    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-clz7w\""
Jul 10 23:18:39.808612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.808588    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"]
Jul 10 23:18:39.939895 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.939859    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht59r\" (UniqueName: \"kubernetes.io/projected/c697ceb5-aa73-4040-b337-561e77f4cab9-kube-api-access-ht59r\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:39.939895 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:39.939899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697ceb5-aa73-4040-b337-561e77f4cab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.040576 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.040470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht59r\" (UniqueName: \"kubernetes.io/projected/c697ceb5-aa73-4040-b337-561e77f4cab9-kube-api-access-ht59r\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.040576 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.040553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697ceb5-aa73-4040-b337-561e77f4cab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.040910 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.040893    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c697ceb5-aa73-4040-b337-561e77f4cab9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.049710 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.049675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht59r\" (UniqueName: \"kubernetes.io/projected/c697ceb5-aa73-4040-b337-561e77f4cab9-kube-api-access-ht59r\") pod \"kuadrant-operator-controller-manager-86878c769f-qs7vt\" (UID: \"c697ceb5-aa73-4040-b337-561e77f4cab9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.111267 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.111226    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.257226 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.257199    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"]
Jul 10 23:18:40.257701 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:18:40.257676    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc697ceb5_aa73_4040_b337_561e77f4cab9.slice/crio-9344187e193b43b5473f4d7c52dd2f6ee6cefd218d813d6d9bc0867e32641cd5 WatchSource:0}: Error finding container 9344187e193b43b5473f4d7c52dd2f6ee6cefd218d813d6d9bc0867e32641cd5: Status 404 returned error can't find the container with id 9344187e193b43b5473f4d7c52dd2f6ee6cefd218d813d6d9bc0867e32641cd5
Jul 10 23:18:40.889053 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.889014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt" event={"ID":"c697ceb5-aa73-4040-b337-561e77f4cab9","Type":"ContainerStarted","Data":"92dc0abef77d1fbe20e884744cb9a90fcfa3936d960100edf555fa2592ef6fc2"}
Jul 10 23:18:40.889431 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.889078    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt" event={"ID":"c697ceb5-aa73-4040-b337-561e77f4cab9","Type":"ContainerStarted","Data":"9344187e193b43b5473f4d7c52dd2f6ee6cefd218d813d6d9bc0867e32641cd5"}
Jul 10 23:18:40.889431 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.889187    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:18:40.911469 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:40.911414    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt" podStartSLOduration=1.91139436 podStartE2EDuration="1.91139436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:18:40.909677519 +0000 UTC m=+1366.885232521" watchObservedRunningTime="2026-07-10 23:18:40.91139436 +0000 UTC m=+1366.886949365"
Jul 10 23:18:51.896777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:18:51.896749    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qs7vt"
Jul 10 23:20:54.845127 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:20:54.845099    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:20:54.848387 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:20:54.848367    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:24:54.068350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.068314    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:24:54.072221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.072200    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.075143 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.075121    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6ec12ec4-openshift-default-dockercfg-nlqf5\""
Jul 10 23:24:54.088076 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.088045    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:24:54.140977 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.140949    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlk4m\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141110 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.140981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141110 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141238 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141238 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141238 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141372 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141372 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.141372 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.141354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.241783 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.241783 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlk4m\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.241970    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242130    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242335    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.242732 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.242706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.244171 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.244152    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.244680 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.244664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.249670 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.249645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlk4m\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.250017 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.250002    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token\") pod \"e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") " pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.385352 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.385323    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6ec12ec4-openshift-default-dockercfg-nlqf5\""
Jul 10 23:24:54.393338 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.393311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:54.532041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.532006    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:24:54.532940 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:24:54.532915    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffa7369_3c74_4578_a0ff_f4227bef071c.slice/crio-ea3bf45f1ac4406bb30fdcfa574a423f0401aab1013f366027e74ede59e78c4f WatchSource:0}: Error finding container ea3bf45f1ac4406bb30fdcfa574a423f0401aab1013f366027e74ede59e78c4f: Status 404 returned error can't find the container with id ea3bf45f1ac4406bb30fdcfa574a423f0401aab1013f366027e74ede59e78c4f
Jul 10 23:24:54.535175 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.535135    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:24:54.535270 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.535220    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:24:54.535270 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.535260    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 10 23:24:54.873736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.873648    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" event={"ID":"cffa7369-3c74-4578-a0ff-f4227bef071c","Type":"ContainerStarted","Data":"6372f4355300010d53b43267b7b69189e54e1e858d6a4e564b1f1b17f5e21a3e"}
Jul 10 23:24:54.873736 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.873698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" event={"ID":"cffa7369-3c74-4578-a0ff-f4227bef071c","Type":"ContainerStarted","Data":"ea3bf45f1ac4406bb30fdcfa574a423f0401aab1013f366027e74ede59e78c4f"}
Jul 10 23:24:54.893579 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:54.893524    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" podStartSLOduration=0.893480397 podStartE2EDuration="893.480397ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:24:54.893319769 +0000 UTC m=+1740.868874772" watchObservedRunningTime="2026-07-10 23:24:54.893480397 +0000 UTC m=+1740.869035399"
Jul 10 23:24:55.394248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:55.394214    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:55.399183 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:55.399162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:55.880178 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:55.880091    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:24:55.881061 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:24:55.881038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:25:00.450024 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:00.449988    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:25:00.450431 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:00.450184    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" podUID="cffa7369-3c74-4578-a0ff-f4227bef071c" containerName="istio-proxy" containerID="cri-o://6372f4355300010d53b43267b7b69189e54e1e858d6a4e564b1f1b17f5e21a3e" gracePeriod=30
Jul 10 23:25:06.941814 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:06.941571    2558 generic.go:356] "Generic (PLEG): container finished" podID="cffa7369-3c74-4578-a0ff-f4227bef071c" containerID="6372f4355300010d53b43267b7b69189e54e1e858d6a4e564b1f1b17f5e21a3e" exitCode=0
Jul 10 23:25:06.941814 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:06.941635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" event={"ID":"cffa7369-3c74-4578-a0ff-f4227bef071c","Type":"ContainerDied","Data":"6372f4355300010d53b43267b7b69189e54e1e858d6a4e564b1f1b17f5e21a3e"}
Jul 10 23:25:07.008150 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.008127    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:25:07.063487 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063487 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063441    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063487 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063469    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063620    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063717    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlk4m\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063743    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063769    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy\") pod \"cffa7369-3c74-4578-a0ff-f4227bef071c\" (UID: \"cffa7369-3c74-4578-a0ff-f4227bef071c\") "
Jul 10 23:25:07.063796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063743    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:25:07.064179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.063799    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:25:07.064179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.064091    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-socket\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.064179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.064112    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-workload-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.064179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.064123    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:25:07.065401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.064725    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:25:07.065401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.065359    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:25:07.066268 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.066238    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 23:25:07.066638 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.066609    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:25:07.066730 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.066687    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:25:07.066820 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.066803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m" (OuterVolumeSpecName: "kube-api-access-hlk4m") pod "cffa7369-3c74-4578-a0ff-f4227bef071c" (UID: "cffa7369-3c74-4578-a0ff-f4227bef071c"). InnerVolumeSpecName "kube-api-access-hlk4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:25:07.165075 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165042    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-data\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165075 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165069    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-token\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165075 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165079    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlk4m\" (UniqueName: \"kubernetes.io/projected/cffa7369-3c74-4578-a0ff-f4227bef071c-kube-api-access-hlk4m\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165075 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165088    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cffa7369-3c74-4578-a0ff-f4227bef071c-istiod-ca-cert\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165335 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165097    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-envoy\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165335 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165104    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cffa7369-3c74-4578-a0ff-f4227bef071c-istio-podinfo\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.165335 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.165112    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cffa7369-3c74-4578-a0ff-f4227bef071c-credential-socket\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:07.695325 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.695278    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:07.695845 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.695825    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cffa7369-3c74-4578-a0ff-f4227bef071c" containerName="istio-proxy"
Jul 10 23:25:07.695845 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.695845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cffa7369-3c74-4578-a0ff-f4227bef071c" containerName="istio-proxy"
Jul 10 23:25:07.695988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.695964    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cffa7369-3c74-4578-a0ff-f4227bef071c" containerName="istio-proxy"
Jul 10 23:25:07.698685 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.698662    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.700834 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.700815    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-76896fa5-serving-cert\""
Jul 10 23:25:07.708821 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.708786    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:07.772350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.772311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.772548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.772354    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.772548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.772408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdgvg\" (UniqueName: \"kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.873828 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.873786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.873828 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.873835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.874024 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.873863    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdgvg\" (UniqueName: \"kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.874024 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:25:07.873953    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-serving-cert: secret "maas-api-e2e-ait-76896fa5-serving-cert" not found
Jul 10 23:25:07.874024 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:25:07.874023    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls podName:e0d1ff23-d714-487b-8f37-ad6bb037a784 nodeName:}" failed. No retries permitted until 2026-07-10 23:25:08.374003665 +0000 UTC m=+1754.349558652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls") pod "maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" (UID: "e0d1ff23-d714-487b-8f37-ad6bb037a784") : secret "maas-api-e2e-ait-76896fa5-serving-cert" not found
Jul 10 23:25:07.874424 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.874404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.882443 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.882414    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdgvg\" (UniqueName: \"kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:07.947715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.947626    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz" event={"ID":"cffa7369-3c74-4578-a0ff-f4227bef071c","Type":"ContainerDied","Data":"ea3bf45f1ac4406bb30fdcfa574a423f0401aab1013f366027e74ede59e78c4f"}
Jul 10 23:25:07.947715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.947661    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"
Jul 10 23:25:07.947715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.947687    2558 scope.go:117] "RemoveContainer" containerID="6372f4355300010d53b43267b7b69189e54e1e858d6a4e564b1f1b17f5e21a3e"
Jul 10 23:25:07.970247 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.970211    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:25:07.973520 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:07.973482    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6ec12ec4-openshift-default-85fd58c4fc-q6kkz"]
Jul 10 23:25:08.380516 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.380396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:08.383420 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.383388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") pod \"maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:08.539995 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.539960    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cffa7369-3c74-4578-a0ff-f4227bef071c" path="/var/lib/kubelet/pods/cffa7369-3c74-4578-a0ff-f4227bef071c/volumes"
Jul 10 23:25:08.611652 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.611623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:08.753887 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.753864    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:08.755973 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:25:08.755946    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d1ff23_d714_487b_8f37_ad6bb037a784.slice/crio-ab0e1a2b5e01b1e95c76aee796696ee63593fd4296d1a58f5f85e70f3e75741b WatchSource:0}: Error finding container ab0e1a2b5e01b1e95c76aee796696ee63593fd4296d1a58f5f85e70f3e75741b: Status 404 returned error can't find the container with id ab0e1a2b5e01b1e95c76aee796696ee63593fd4296d1a58f5f85e70f3e75741b
Jul 10 23:25:08.757527 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.757483    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:25:08.954326 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:08.954236    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" event={"ID":"e0d1ff23-d714-487b-8f37-ad6bb037a784","Type":"ContainerStarted","Data":"ab0e1a2b5e01b1e95c76aee796696ee63593fd4296d1a58f5f85e70f3e75741b"}
Jul 10 23:25:09.963720 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:09.963602    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" event={"ID":"e0d1ff23-d714-487b-8f37-ad6bb037a784","Type":"ContainerStarted","Data":"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"}
Jul 10 23:25:09.964176 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:09.963799    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:09.983870 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:09.983820    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" podStartSLOduration=2.612631499 podStartE2EDuration="2.983803112s" totalImagesPullingTime="371.171613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:25:09.980981313 +0000 UTC m=+1755.956536318" watchObservedRunningTime="2026-07-10 23:25:09.983803112 +0000 UTC m=+1755.959358154"
Jul 10 23:25:13.168222 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.168185    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:13.168708 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.168488    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" podUID="e0d1ff23-d714-487b-8f37-ad6bb037a784" containerName="maas-api" containerID="cri-o://e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b" gracePeriod=30
Jul 10 23:25:13.425258 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.425196    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:13.529340 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.529304    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca\") pod \"e0d1ff23-d714-487b-8f37-ad6bb037a784\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") "
Jul 10 23:25:13.529534 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.529465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") pod \"e0d1ff23-d714-487b-8f37-ad6bb037a784\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") "
Jul 10 23:25:13.529582 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.529529    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdgvg\" (UniqueName: \"kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg\") pod \"e0d1ff23-d714-487b-8f37-ad6bb037a784\" (UID: \"e0d1ff23-d714-487b-8f37-ad6bb037a784\") "
Jul 10 23:25:13.529750 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.529728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0d1ff23-d714-487b-8f37-ad6bb037a784" (UID: "e0d1ff23-d714-487b-8f37-ad6bb037a784"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:25:13.529824 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.529809    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0d1ff23-d714-487b-8f37-ad6bb037a784-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:13.531824 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.531803    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0d1ff23-d714-487b-8f37-ad6bb037a784" (UID: "e0d1ff23-d714-487b-8f37-ad6bb037a784"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:25:13.531919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.531903    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg" (OuterVolumeSpecName: "kube-api-access-fdgvg") pod "e0d1ff23-d714-487b-8f37-ad6bb037a784" (UID: "e0d1ff23-d714-487b-8f37-ad6bb037a784"). InnerVolumeSpecName "kube-api-access-fdgvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:25:13.631392 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.631358    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0d1ff23-d714-487b-8f37-ad6bb037a784-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:13.631392 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.631390    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdgvg\" (UniqueName: \"kubernetes.io/projected/e0d1ff23-d714-487b-8f37-ad6bb037a784-kube-api-access-fdgvg\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:13.987212 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.987175    2558 generic.go:356] "Generic (PLEG): container finished" podID="e0d1ff23-d714-487b-8f37-ad6bb037a784" containerID="e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b" exitCode=0
Jul 10 23:25:13.987423 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.987221    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"
Jul 10 23:25:13.987423 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.987261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" event={"ID":"e0d1ff23-d714-487b-8f37-ad6bb037a784","Type":"ContainerDied","Data":"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"}
Jul 10 23:25:13.987423 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.987315    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h" event={"ID":"e0d1ff23-d714-487b-8f37-ad6bb037a784","Type":"ContainerDied","Data":"ab0e1a2b5e01b1e95c76aee796696ee63593fd4296d1a58f5f85e70f3e75741b"}
Jul 10 23:25:13.987423 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.987338    2558 scope.go:117] "RemoveContainer" containerID="e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"
Jul 10 23:25:13.998982 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.998746    2558 scope.go:117] "RemoveContainer" containerID="e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"
Jul 10 23:25:13.999695 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:25:13.999668    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b\": container with ID starting with e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b not found: ID does not exist" containerID="e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"
Jul 10 23:25:13.999791 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:13.999703    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b"} err="failed to get container status \"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b\": rpc error: code = NotFound desc = could not find container \"e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b\": container with ID starting with e56b08d42b1b554aef01dc987219afb53d2a8e916fe6fc6f3922a1321778024b not found: ID does not exist"
Jul 10 23:25:14.008350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:14.008324    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:14.011839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:14.011811    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-76896fa5-8bcbbcd6c-zkk8h"]
Jul 10 23:25:14.541467 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:14.541432    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d1ff23-d714-487b-8f37-ad6bb037a784" path="/var/lib/kubelet/pods/e0d1ff23-d714-487b-8f37-ad6bb037a784/volumes"
Jul 10 23:25:26.006213 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.006172    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:26.006755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.006721    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d1ff23-d714-487b-8f37-ad6bb037a784" containerName="maas-api"
Jul 10 23:25:26.006755 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.006737    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d1ff23-d714-487b-8f37-ad6bb037a784" containerName="maas-api"
Jul 10 23:25:26.006852 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.006833    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d1ff23-d714-487b-8f37-ad6bb037a784" containerName="maas-api"
Jul 10 23:25:26.015906 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.015877    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.018289 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.018252    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-23bee0fd-serving-cert\""
Jul 10 23:25:26.021381 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.021356    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:26.141921 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.141882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.142094 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.141935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.142094 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.141997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ww9g\" (UniqueName: \"kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.243273 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.243237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.243470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.243292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.243470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.243344    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ww9g\" (UniqueName: \"kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.244029 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.243972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.245792 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.245773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.261825 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.261759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ww9g\" (UniqueName: \"kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g\") pod \"maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.330997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.330964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:26.482708 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:26.482677    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:26.484338 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:25:26.484306    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a3b928_7110_4411_a111_932a87cf5ebb.slice/crio-561e71982083244f5bbe7b481218b4d7c47089debd64a9a97ba138e3eaa6e8b2 WatchSource:0}: Error finding container 561e71982083244f5bbe7b481218b4d7c47089debd64a9a97ba138e3eaa6e8b2: Status 404 returned error can't find the container with id 561e71982083244f5bbe7b481218b4d7c47089debd64a9a97ba138e3eaa6e8b2
Jul 10 23:25:27.057004 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:27.056965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" event={"ID":"38a3b928-7110-4411-a111-932a87cf5ebb","Type":"ContainerStarted","Data":"63380dcfb1127e82d94b1c905cf8a03b019d9e97331d963ce2304a604edbf1e6"}
Jul 10 23:25:27.057538 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:27.057027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" event={"ID":"38a3b928-7110-4411-a111-932a87cf5ebb","Type":"ContainerStarted","Data":"561e71982083244f5bbe7b481218b4d7c47089debd64a9a97ba138e3eaa6e8b2"}
Jul 10 23:25:27.057538 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:27.057159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:27.073366 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:27.073311    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" podStartSLOduration=1.713643008 podStartE2EDuration="2.073293594s" totalImagesPullingTime="359.650586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:25:27.072292198 +0000 UTC m=+1773.047847227" watchObservedRunningTime="2026-07-10 23:25:27.073293594 +0000 UTC m=+1773.048848596"
Jul 10 23:25:30.867397 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:30.867167    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:30.867397 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:30.867350    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" podUID="38a3b928-7110-4411-a111-932a87cf5ebb" containerName="maas-api" containerID="cri-o://63380dcfb1127e82d94b1c905cf8a03b019d9e97331d963ce2304a604edbf1e6" gracePeriod=30
Jul 10 23:25:31.084589 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.084553    2558 generic.go:356] "Generic (PLEG): container finished" podID="38a3b928-7110-4411-a111-932a87cf5ebb" containerID="63380dcfb1127e82d94b1c905cf8a03b019d9e97331d963ce2304a604edbf1e6" exitCode=0
Jul 10 23:25:31.084751 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.084622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" event={"ID":"38a3b928-7110-4411-a111-932a87cf5ebb","Type":"ContainerDied","Data":"63380dcfb1127e82d94b1c905cf8a03b019d9e97331d963ce2304a604edbf1e6"}
Jul 10 23:25:31.124097 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.124034    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:31.292396 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.292360    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca\") pod \"38a3b928-7110-4411-a111-932a87cf5ebb\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") "
Jul 10 23:25:31.292594 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.292409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls\") pod \"38a3b928-7110-4411-a111-932a87cf5ebb\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") "
Jul 10 23:25:31.292594 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.292454    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ww9g\" (UniqueName: \"kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g\") pod \"38a3b928-7110-4411-a111-932a87cf5ebb\" (UID: \"38a3b928-7110-4411-a111-932a87cf5ebb\") "
Jul 10 23:25:31.292818 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.292790    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38a3b928-7110-4411-a111-932a87cf5ebb" (UID: "38a3b928-7110-4411-a111-932a87cf5ebb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:25:31.294785 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.294764    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g" (OuterVolumeSpecName: "kube-api-access-7ww9g") pod "38a3b928-7110-4411-a111-932a87cf5ebb" (UID: "38a3b928-7110-4411-a111-932a87cf5ebb"). InnerVolumeSpecName "kube-api-access-7ww9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:25:31.294831 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.294806    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38a3b928-7110-4411-a111-932a87cf5ebb" (UID: "38a3b928-7110-4411-a111-932a87cf5ebb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:25:31.393200 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.393165    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38a3b928-7110-4411-a111-932a87cf5ebb-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:31.393200 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.393196    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38a3b928-7110-4411-a111-932a87cf5ebb-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:31.393200 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:31.393207    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ww9g\" (UniqueName: \"kubernetes.io/projected/38a3b928-7110-4411-a111-932a87cf5ebb-kube-api-access-7ww9g\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:25:32.091108 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.091078    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"
Jul 10 23:25:32.091554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.091114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z" event={"ID":"38a3b928-7110-4411-a111-932a87cf5ebb","Type":"ContainerDied","Data":"561e71982083244f5bbe7b481218b4d7c47089debd64a9a97ba138e3eaa6e8b2"}
Jul 10 23:25:32.091554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.091172    2558 scope.go:117] "RemoveContainer" containerID="63380dcfb1127e82d94b1c905cf8a03b019d9e97331d963ce2304a604edbf1e6"
Jul 10 23:25:32.111187 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.111162    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:32.114424 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.114401    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-23bee0fd-7cf6bf7577-dz76z"]
Jul 10 23:25:32.541113 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:32.541071    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a3b928-7110-4411-a111-932a87cf5ebb" path="/var/lib/kubelet/pods/38a3b928-7110-4411-a111-932a87cf5ebb/volumes"
Jul 10 23:25:54.885183 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:54.885156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:25:54.890066 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:25:54.890043    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:27:13.542642 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.542608    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:13.543064 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.543033    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a3b928-7110-4411-a111-932a87cf5ebb" containerName="maas-api"
Jul 10 23:27:13.543064 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.543046    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a3b928-7110-4411-a111-932a87cf5ebb" containerName="maas-api"
Jul 10 23:27:13.543139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.543129    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a3b928-7110-4411-a111-932a87cf5ebb" containerName="maas-api"
Jul 10 23:27:13.546192 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.546172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.548587 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.548567    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-62569fb2-serving-cert\""
Jul 10 23:27:13.557742 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.557719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:13.681612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.681574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.681810 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.681660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrnd\" (UniqueName: \"kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.681810 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.681770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.782985 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.782945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.783204 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.783031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.783204 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.783068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrnd\" (UniqueName: \"kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.783204 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:27:13.783172    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-serving-cert: secret "maas-api-e2e-mt-62569fb2-serving-cert" not found
Jul 10 23:27:13.783312 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:27:13.783254    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls podName:dcca4d49-bf0e-455a-a68c-90cbcac7436c nodeName:}" failed. No retries permitted until 2026-07-10 23:27:14.283234106 +0000 UTC m=+1880.258789094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls") pod "maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" (UID: "dcca4d49-bf0e-455a-a68c-90cbcac7436c") : secret "maas-api-e2e-mt-62569fb2-serving-cert" not found
Jul 10 23:27:13.783646 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.783626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:13.793179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:13.793111    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrnd\" (UniqueName: \"kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:14.287466 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:14.287421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:14.290345 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:14.290316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") pod \"maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:14.458639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:14.458601    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:14.604597 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:14.604572    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:14.606403 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:27:14.606375    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcca4d49_bf0e_455a_a68c_90cbcac7436c.slice/crio-19ff8adaea4276e3ac5727f7b58f100c61668ca402088346764152c09754ae65 WatchSource:0}: Error finding container 19ff8adaea4276e3ac5727f7b58f100c61668ca402088346764152c09754ae65: Status 404 returned error can't find the container with id 19ff8adaea4276e3ac5727f7b58f100c61668ca402088346764152c09754ae65
Jul 10 23:27:14.632561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:14.632530    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" event={"ID":"dcca4d49-bf0e-455a-a68c-90cbcac7436c","Type":"ContainerStarted","Data":"19ff8adaea4276e3ac5727f7b58f100c61668ca402088346764152c09754ae65"}
Jul 10 23:27:15.639199 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:15.639167    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" event={"ID":"dcca4d49-bf0e-455a-a68c-90cbcac7436c","Type":"ContainerStarted","Data":"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"}
Jul 10 23:27:15.639737 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:15.639254    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:15.655746 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:15.655698    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" podStartSLOduration=2.230309173 podStartE2EDuration="2.655683967s" totalImagesPullingTime="425.374794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:27:15.653284178 +0000 UTC m=+1881.628839181" watchObservedRunningTime="2026-07-10 23:27:15.655683967 +0000 UTC m=+1881.631238968"
Jul 10 23:27:21.650391 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:21.650361    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:25.737554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:25.737521    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:25.738036 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:25.737725    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" podUID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" containerName="maas-api" containerID="cri-o://643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d" gracePeriod=30
Jul 10 23:27:25.998862 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:25.998807    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:26.103524 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.103465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") pod \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") "
Jul 10 23:27:26.103698 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.103556    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtrnd\" (UniqueName: \"kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd\") pod \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") "
Jul 10 23:27:26.103698 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.103643    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca\") pod \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\" (UID: \"dcca4d49-bf0e-455a-a68c-90cbcac7436c\") "
Jul 10 23:27:26.104015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.103992    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dcca4d49-bf0e-455a-a68c-90cbcac7436c" (UID: "dcca4d49-bf0e-455a-a68c-90cbcac7436c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:27:26.105738 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.105713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dcca4d49-bf0e-455a-a68c-90cbcac7436c" (UID: "dcca4d49-bf0e-455a-a68c-90cbcac7436c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:27:26.105738 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.105717    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd" (OuterVolumeSpecName: "kube-api-access-wtrnd") pod "dcca4d49-bf0e-455a-a68c-90cbcac7436c" (UID: "dcca4d49-bf0e-455a-a68c-90cbcac7436c"). InnerVolumeSpecName "kube-api-access-wtrnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:27:26.205118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.205073    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtrnd\" (UniqueName: \"kubernetes.io/projected/dcca4d49-bf0e-455a-a68c-90cbcac7436c-kube-api-access-wtrnd\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:27:26.205118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.205109    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcca4d49-bf0e-455a-a68c-90cbcac7436c-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:27:26.205118 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.205122    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dcca4d49-bf0e-455a-a68c-90cbcac7436c-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:27:26.696936 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.696900    2558 generic.go:356] "Generic (PLEG): container finished" podID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" containerID="643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d" exitCode=0
Jul 10 23:27:26.697141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.696950    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"
Jul 10 23:27:26.697141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.696986    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" event={"ID":"dcca4d49-bf0e-455a-a68c-90cbcac7436c","Type":"ContainerDied","Data":"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"}
Jul 10 23:27:26.697141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.697040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss" event={"ID":"dcca4d49-bf0e-455a-a68c-90cbcac7436c","Type":"ContainerDied","Data":"19ff8adaea4276e3ac5727f7b58f100c61668ca402088346764152c09754ae65"}
Jul 10 23:27:26.697141 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.697072    2558 scope.go:117] "RemoveContainer" containerID="643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"
Jul 10 23:27:26.707129 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.707111    2558 scope.go:117] "RemoveContainer" containerID="643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"
Jul 10 23:27:26.707393 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:27:26.707371    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d\": container with ID starting with 643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d not found: ID does not exist" containerID="643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"
Jul 10 23:27:26.707443 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.707401    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d"} err="failed to get container status \"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d\": rpc error: code = NotFound desc = could not find container \"643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d\": container with ID starting with 643f90c3e1a3c85430700b67d37b4f6dc63a6a9fe00c1235788350293d4ccc3d not found: ID does not exist"
Jul 10 23:27:26.713364 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.713339    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:26.716220 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:26.716197    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-62569fb2-787ff9bcf8-qnwss"]
Jul 10 23:27:28.540469 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:28.540438    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" path="/var/lib/kubelet/pods/dcca4d49-bf0e-455a-a68c-90cbcac7436c/volumes"
Jul 10 23:27:53.763442 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.763405    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:27:53.764047 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.763870    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" containerName="maas-api"
Jul 10 23:27:53.764047 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.763888    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" containerName="maas-api"
Jul 10 23:27:53.764047 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.763972    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcca4d49-bf0e-455a-a68c-90cbcac7436c" containerName="maas-api"
Jul 10 23:27:53.767307 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.767283    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.769839 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.769816    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7e40d510-serving-cert\""
Jul 10 23:27:53.776237 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.776217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:27:53.868045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.867993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.868045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.868059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.868319 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.868139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs226\" (UniqueName: \"kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.969280 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.969239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.969280 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.969280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.969568 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.969322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs226\" (UniqueName: \"kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.969568 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:27:53.969450    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-serving-cert: secret "maas-api-e2e-mt-7e40d510-serving-cert" not found
Jul 10 23:27:53.969927 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:27:53.969587    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls podName:e02c451a-9453-429d-b638-a865a4408f12 nodeName:}" failed. No retries permitted until 2026-07-10 23:27:54.469560196 +0000 UTC m=+1920.445115192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls") pod "maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" (UID: "e02c451a-9453-429d-b638-a865a4408f12") : secret "maas-api-e2e-mt-7e40d510-serving-cert" not found
Jul 10 23:27:53.970067 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.970049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:53.980263 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:53.980234    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs226\" (UniqueName: \"kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:54.474559 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:54.474486    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:54.477051 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:54.477026    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") pod \"maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:54.679365 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:54.679334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:54.820942 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:54.820914    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:27:54.822642 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:27:54.822612    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02c451a_9453_429d_b638_a865a4408f12.slice/crio-765b442b119e0cf2613e64ca53fd42f0310e6b843ec27e55b157cde6f4daf9c5 WatchSource:0}: Error finding container 765b442b119e0cf2613e64ca53fd42f0310e6b843ec27e55b157cde6f4daf9c5: Status 404 returned error can't find the container with id 765b442b119e0cf2613e64ca53fd42f0310e6b843ec27e55b157cde6f4daf9c5
Jul 10 23:27:54.842872 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:54.842841    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" event={"ID":"e02c451a-9453-429d-b638-a865a4408f12","Type":"ContainerStarted","Data":"765b442b119e0cf2613e64ca53fd42f0310e6b843ec27e55b157cde6f4daf9c5"}
Jul 10 23:27:55.849556 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:55.849495    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" event={"ID":"e02c451a-9453-429d-b638-a865a4408f12","Type":"ContainerStarted","Data":"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"}
Jul 10 23:27:55.849988 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:55.849609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:27:55.865553 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:27:55.865488    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" podStartSLOduration=2.502318313 podStartE2EDuration="2.865469923s" totalImagesPullingTime="363.15161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:27:55.864124392 +0000 UTC m=+1921.839679399" watchObservedRunningTime="2026-07-10 23:27:55.865469923 +0000 UTC m=+1921.841024924"
Jul 10 23:28:01.863239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:01.863206    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:28:36.374613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.374574    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:28:36.375192 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.375158    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" podUID="e02c451a-9453-429d-b638-a865a4408f12" containerName="maas-api" containerID="cri-o://596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6" gracePeriod=30
Jul 10 23:28:36.628294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.628225    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:28:36.779456 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.779421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs226\" (UniqueName: \"kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226\") pod \"e02c451a-9453-429d-b638-a865a4408f12\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") "
Jul 10 23:28:36.779702 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.779554    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca\") pod \"e02c451a-9453-429d-b638-a865a4408f12\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") "
Jul 10 23:28:36.779702 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.779626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") pod \"e02c451a-9453-429d-b638-a865a4408f12\" (UID: \"e02c451a-9453-429d-b638-a865a4408f12\") "
Jul 10 23:28:36.779998 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.779963    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e02c451a-9453-429d-b638-a865a4408f12" (UID: "e02c451a-9453-429d-b638-a865a4408f12"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:28:36.781943 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.781919    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e02c451a-9453-429d-b638-a865a4408f12" (UID: "e02c451a-9453-429d-b638-a865a4408f12"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:28:36.782038 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.781955    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226" (OuterVolumeSpecName: "kube-api-access-vs226") pod "e02c451a-9453-429d-b638-a865a4408f12" (UID: "e02c451a-9453-429d-b638-a865a4408f12"). InnerVolumeSpecName "kube-api-access-vs226". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:28:36.881241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.881146    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs226\" (UniqueName: \"kubernetes.io/projected/e02c451a-9453-429d-b638-a865a4408f12-kube-api-access-vs226\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:28:36.881241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.881181    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c451a-9453-429d-b638-a865a4408f12-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:28:36.881241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:36.881196    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c451a-9453-429d-b638-a865a4408f12-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:28:37.074224 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.074191    2558 generic.go:356] "Generic (PLEG): container finished" podID="e02c451a-9453-429d-b638-a865a4408f12" containerID="596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6" exitCode=0
Jul 10 23:28:37.074419 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.074231    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"
Jul 10 23:28:37.074419 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.074273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" event={"ID":"e02c451a-9453-429d-b638-a865a4408f12","Type":"ContainerDied","Data":"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"}
Jul 10 23:28:37.074419 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.074329    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597" event={"ID":"e02c451a-9453-429d-b638-a865a4408f12","Type":"ContainerDied","Data":"765b442b119e0cf2613e64ca53fd42f0310e6b843ec27e55b157cde6f4daf9c5"}
Jul 10 23:28:37.074419 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.074358    2558 scope.go:117] "RemoveContainer" containerID="596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"
Jul 10 23:28:37.083959 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.083937    2558 scope.go:117] "RemoveContainer" containerID="596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"
Jul 10 23:28:37.084207 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:28:37.084189    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6\": container with ID starting with 596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6 not found: ID does not exist" containerID="596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"
Jul 10 23:28:37.084269 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.084219    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6"} err="failed to get container status \"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6\": rpc error: code = NotFound desc = could not find container \"596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6\": container with ID starting with 596d2c8465e2a15b72ad84b48bde77fff9923b0940d1f577145369c1b545b3a6 not found: ID does not exist"
Jul 10 23:28:37.097526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.097485    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:28:37.101334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:37.101315    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e40d510-5fb6cf4bb8-jq597"]
Jul 10 23:28:38.540411 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:28:38.540383    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e02c451a-9453-429d-b638-a865a4408f12" path="/var/lib/kubelet/pods/e02c451a-9453-429d-b638-a865a4408f12/volumes"
Jul 10 23:30:40.656789 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.656700    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:30:40.659369 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.657144    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02c451a-9453-429d-b638-a865a4408f12" containerName="maas-api"
Jul 10 23:30:40.659369 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.657157    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02c451a-9453-429d-b638-a865a4408f12" containerName="maas-api"
Jul 10 23:30:40.659369 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.657225    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02c451a-9453-429d-b638-a865a4408f12" containerName="maas-api"
Jul 10 23:30:40.660188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.660167    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.662435 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.662400    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-43530d-serving-cert\""
Jul 10 23:30:40.674746 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.674719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:30:40.733666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.733639    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.733831 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.733681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xx8\" (UniqueName: \"kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.733831 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.733719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.834762 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.834723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.834943 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.834773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xx8\" (UniqueName: \"kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.834943 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.834794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.834943 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:30:40.834870    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-serving-cert: secret "maas-api-e2e-inf-a-43530d-serving-cert" not found
Jul 10 23:30:40.834943 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:30:40.834941    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls podName:a5c25b41-6a51-4aa9-9bb7-6487c4558fab nodeName:}" failed. No retries permitted until 2026-07-10 23:30:41.334924103 +0000 UTC m=+2087.310479083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls") pod "maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" (UID: "a5c25b41-6a51-4aa9-9bb7-6487c4558fab") : secret "maas-api-e2e-inf-a-43530d-serving-cert" not found
Jul 10 23:30:40.835477 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.835459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:40.848483 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:40.848452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xx8\" (UniqueName: \"kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:41.339636 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:41.339601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:41.342313 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:41.342284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") pod \"maas-api-e2e-inf-a-43530d-856d5b8c47-g757x\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:41.572702 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:41.572663    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:41.718666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:41.718636    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:30:41.720823 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:30:41.720784    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c25b41_6a51_4aa9_9bb7_6487c4558fab.slice/crio-d863348fabb51582c7831bede0bbab27c0ca45c3f95816177995293643291ee5 WatchSource:0}: Error finding container d863348fabb51582c7831bede0bbab27c0ca45c3f95816177995293643291ee5: Status 404 returned error can't find the container with id d863348fabb51582c7831bede0bbab27c0ca45c3f95816177995293643291ee5
Jul 10 23:30:41.722638 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:41.722620    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:30:42.732612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:42.732579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" event={"ID":"a5c25b41-6a51-4aa9-9bb7-6487c4558fab","Type":"ContainerStarted","Data":"e585e41f1b7712e4a2bfe8e520cff64fb24ab8304225c474203b986bf8c943ea"}
Jul 10 23:30:42.732971 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:42.732627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" event={"ID":"a5c25b41-6a51-4aa9-9bb7-6487c4558fab","Type":"ContainerStarted","Data":"d863348fabb51582c7831bede0bbab27c0ca45c3f95816177995293643291ee5"}
Jul 10 23:30:42.732971 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:42.732704    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:42.748749 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:42.748699    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" podStartSLOduration=2.282929514 podStartE2EDuration="2.748684456s" totalImagesPullingTime="465.754942ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:30:42.74663267 +0000 UTC m=+2088.722187672" watchObservedRunningTime="2026-07-10 23:30:42.748684456 +0000 UTC m=+2088.724239457"
Jul 10 23:30:48.703040 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.703005    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:30:48.707254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.707231    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.709425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.709403    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-56040a-serving-cert\""
Jul 10 23:30:48.718870 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.718846    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:30:48.743221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.743198    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:30:48.810477 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.810445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq7mk\" (UniqueName: \"kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.810656 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.810491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.810656 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.810635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.911800 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.911756    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.912005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.911824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq7mk\" (UniqueName: \"kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.912005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.911865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.912005 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:30:48.911930    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-serving-cert: secret "maas-api-e2e-inf-b-56040a-serving-cert" not found
Jul 10 23:30:48.912270 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:30:48.912021    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls podName:7a28dd76-db38-4cbe-b94a-cc432888be02 nodeName:}" failed. No retries permitted until 2026-07-10 23:30:49.41199896 +0000 UTC m=+2095.387553965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls") pod "maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" (UID: "7a28dd76-db38-4cbe-b94a-cc432888be02") : secret "maas-api-e2e-inf-b-56040a-serving-cert" not found
Jul 10 23:30:48.912634 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.912611    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:48.920342 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:48.920318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq7mk\" (UniqueName: \"kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:49.417439 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:49.417402    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:49.420069 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:49.420040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") pod \"maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:49.619174 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:49.619138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:49.764443 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:49.764400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:30:49.767330 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:30:49.767263    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a28dd76_db38_4cbe_b94a_cc432888be02.slice/crio-e108e08119a8d3fea0b2ddddfbb81c478e517dca65cea350b0505ee7486a4042 WatchSource:0}: Error finding container e108e08119a8d3fea0b2ddddfbb81c478e517dca65cea350b0505ee7486a4042: Status 404 returned error can't find the container with id e108e08119a8d3fea0b2ddddfbb81c478e517dca65cea350b0505ee7486a4042
Jul 10 23:30:50.776849 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:50.776811    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" event={"ID":"7a28dd76-db38-4cbe-b94a-cc432888be02","Type":"ContainerStarted","Data":"5ce9c565b3ee38af4b179f39c84184a5a1b8670602a00bb111aec9bf15dec134"}
Jul 10 23:30:50.777248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:50.776869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" event={"ID":"7a28dd76-db38-4cbe-b94a-cc432888be02","Type":"ContainerStarted","Data":"e108e08119a8d3fea0b2ddddfbb81c478e517dca65cea350b0505ee7486a4042"}
Jul 10 23:30:50.777248 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:50.776917    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:30:50.796715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:50.796669    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" podStartSLOduration=2.466520568 podStartE2EDuration="2.796653183s" totalImagesPullingTime="330.132615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:30:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:30:50.793719965 +0000 UTC m=+2096.769274967" watchObservedRunningTime="2026-07-10 23:30:50.796653183 +0000 UTC m=+2096.772208185"
Jul 10 23:30:54.930083 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:54.930045    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:30:54.935753 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:54.935733    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:30:56.787139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:30:56.787114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:31:46.723327 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.723218    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:31:46.726848 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.726832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.731518 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.731480    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-56040a\"/\"kube-root-ca.crt\""
Jul 10 23:31:46.731632 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.731553    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-56040a\"/\"openshift-service-ca.crt\""
Jul 10 23:31:46.731632 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.731484    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-56040a\"/\"test-model-56040a-kserve-self-signed-certs\""
Jul 10 23:31:46.731748 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.731644    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-56040a\"/\"default-dockercfg-f7wvl\""
Jul 10 23:31:46.736012 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.735990    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:31:46.851968 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.851937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.852154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.851995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.852154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.852027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btxd\" (UniqueName: \"kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.852154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.852093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.852154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.852126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.852154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.852146    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952766 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952766 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btxd\" (UniqueName: \"kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.952997 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.952971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.953314 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.953282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.953666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.953325    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.953666 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.953374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.955228 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.955204    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.955458 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.955442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:46.960232 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:46.960210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btxd\" (UniqueName: \"kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd\") pod \"test-model-56040a-kserve-5d8fbbb99c-csxc6\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") " pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:47.037072 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:47.036999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:47.178913 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:47.178880    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:31:47.179525 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:31:47.179483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod410d6327_0415_4c58_b238_4708ea996d38.slice/crio-24ce862128634f14d162ce5b5eea63312096930a0eac8c5a180934e5896f6985 WatchSource:0}: Error finding container 24ce862128634f14d162ce5b5eea63312096930a0eac8c5a180934e5896f6985: Status 404 returned error can't find the container with id 24ce862128634f14d162ce5b5eea63312096930a0eac8c5a180934e5896f6985
Jul 10 23:31:48.079285 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:48.079245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" event={"ID":"410d6327-0415-4c58-b238-4708ea996d38","Type":"ContainerStarted","Data":"2d52daabe28b663ae8d02bae5c1595c2ba7506a9cba3930c6b72c73208144033"}
Jul 10 23:31:48.079714 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:48.079294    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" event={"ID":"410d6327-0415-4c58-b238-4708ea996d38","Type":"ContainerStarted","Data":"24ce862128634f14d162ce5b5eea63312096930a0eac8c5a180934e5896f6985"}
Jul 10 23:31:48.095213 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:48.095157    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" podStartSLOduration=2.095141846 podStartE2EDuration="2.095141846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:31:48.09371984 +0000 UTC m=+2154.069274842" watchObservedRunningTime="2026-07-10 23:31:48.095141846 +0000 UTC m=+2154.070696847"
Jul 10 23:31:57.038223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:57.038177    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:57.038223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:57.038232    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:57.051150 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:57.051125    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:31:57.144900 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:31:57.144865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:32:13.047606 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:13.047569    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:32:14.110288 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.110242    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:32:14.110818 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.110525    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" podUID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" containerName="maas-api" containerID="cri-o://e585e41f1b7712e4a2bfe8e520cff64fb24ab8304225c474203b986bf8c943ea" gracePeriod=30
Jul 10 23:32:14.227052 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.227023    2558 generic.go:356] "Generic (PLEG): container finished" podID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" containerID="e585e41f1b7712e4a2bfe8e520cff64fb24ab8304225c474203b986bf8c943ea" exitCode=0
Jul 10 23:32:14.227154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.227094    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" event={"ID":"a5c25b41-6a51-4aa9-9bb7-6487c4558fab","Type":"ContainerDied","Data":"e585e41f1b7712e4a2bfe8e520cff64fb24ab8304225c474203b986bf8c943ea"}
Jul 10 23:32:14.373470 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.373401    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:32:14.518526 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.518474    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") pod \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") "
Jul 10 23:32:14.518731 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.518565    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca\") pod \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") "
Jul 10 23:32:14.518731 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.518645    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6xx8\" (UniqueName: \"kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8\") pod \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\" (UID: \"a5c25b41-6a51-4aa9-9bb7-6487c4558fab\") "
Jul 10 23:32:14.518983 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.518959    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5c25b41-6a51-4aa9-9bb7-6487c4558fab" (UID: "a5c25b41-6a51-4aa9-9bb7-6487c4558fab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:32:14.520717 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.520693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5c25b41-6a51-4aa9-9bb7-6487c4558fab" (UID: "a5c25b41-6a51-4aa9-9bb7-6487c4558fab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:32:14.520818 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.520787    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8" (OuterVolumeSpecName: "kube-api-access-c6xx8") pod "a5c25b41-6a51-4aa9-9bb7-6487c4558fab" (UID: "a5c25b41-6a51-4aa9-9bb7-6487c4558fab"). InnerVolumeSpecName "kube-api-access-c6xx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:32:14.619484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.619450    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:14.619484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.619478    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6xx8\" (UniqueName: \"kubernetes.io/projected/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-kube-api-access-c6xx8\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:14.619484 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:14.619490    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c25b41-6a51-4aa9-9bb7-6487c4558fab-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:15.233673 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:15.233643    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"
Jul 10 23:32:15.233673 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:15.233643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x" event={"ID":"a5c25b41-6a51-4aa9-9bb7-6487c4558fab","Type":"ContainerDied","Data":"d863348fabb51582c7831bede0bbab27c0ca45c3f95816177995293643291ee5"}
Jul 10 23:32:15.234135 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:15.233737    2558 scope.go:117] "RemoveContainer" containerID="e585e41f1b7712e4a2bfe8e520cff64fb24ab8304225c474203b986bf8c943ea"
Jul 10 23:32:15.248143 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:15.248116    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:32:15.251798 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:15.251771    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-43530d-856d5b8c47-g757x"]
Jul 10 23:32:16.541026 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:16.540992    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" path="/var/lib/kubelet/pods/a5c25b41-6a51-4aa9-9bb7-6487c4558fab/volumes"
Jul 10 23:32:28.070834 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.070778    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" podUID="410d6327-0415-4c58-b238-4708ea996d38" containerName="main" containerID="cri-o://2d52daabe28b663ae8d02bae5c1595c2ba7506a9cba3930c6b72c73208144033" gracePeriod=45
Jul 10 23:32:28.309561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.309532    2558 generic.go:356] "Generic (PLEG): container finished" podID="410d6327-0415-4c58-b238-4708ea996d38" containerID="2d52daabe28b663ae8d02bae5c1595c2ba7506a9cba3930c6b72c73208144033" exitCode=0
Jul 10 23:32:28.309770 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.309600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" event={"ID":"410d6327-0415-4c58-b238-4708ea996d38","Type":"ContainerDied","Data":"2d52daabe28b663ae8d02bae5c1595c2ba7506a9cba3930c6b72c73208144033"}
Jul 10 23:32:28.331041 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.330978    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:32:28.458059 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458026    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6btxd\" (UniqueName: \"kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458256 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458092    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458256 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458202    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458383 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458283    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458383 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458350    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458383 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458378    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home\") pod \"410d6327-0415-4c58-b238-4708ea996d38\" (UID: \"410d6327-0415-4c58-b238-4708ea996d38\") "
Jul 10 23:32:28.458602 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458576    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache" (OuterVolumeSpecName: "model-cache") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:32:28.458734 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458623    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:32:28.458796 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home" (OuterVolumeSpecName: "home") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:32:28.458844 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458811    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-model-cache\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:28.458968 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.458908    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-tmp-dir\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:28.460644 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.460597    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm" (OuterVolumeSpecName: "dshm") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:32:28.460644 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.460630    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:32:28.460766 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.460690    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd" (OuterVolumeSpecName: "kube-api-access-6btxd") pod "410d6327-0415-4c58-b238-4708ea996d38" (UID: "410d6327-0415-4c58-b238-4708ea996d38"). InnerVolumeSpecName "kube-api-access-6btxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:32:28.559462 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.559429    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6btxd\" (UniqueName: \"kubernetes.io/projected/410d6327-0415-4c58-b238-4708ea996d38-kube-api-access-6btxd\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:28.559462 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.559458    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/410d6327-0415-4c58-b238-4708ea996d38-tls-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:28.559655 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.559471    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-dshm\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:28.559655 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:28.559482    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/410d6327-0415-4c58-b238-4708ea996d38-home\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:29.316090 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:29.316052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6" event={"ID":"410d6327-0415-4c58-b238-4708ea996d38","Type":"ContainerDied","Data":"24ce862128634f14d162ce5b5eea63312096930a0eac8c5a180934e5896f6985"}
Jul 10 23:32:29.316588 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:29.316111    2558 scope.go:117] "RemoveContainer" containerID="2d52daabe28b663ae8d02bae5c1595c2ba7506a9cba3930c6b72c73208144033"
Jul 10 23:32:29.316588 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:29.316062    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"
Jul 10 23:32:29.331686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:29.331656    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:32:29.333922 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:29.333903    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-56040a/test-model-56040a-kserve-5d8fbbb99c-csxc6"]
Jul 10 23:32:30.540048 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:30.540013    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="410d6327-0415-4c58-b238-4708ea996d38" path="/var/lib/kubelet/pods/410d6327-0415-4c58-b238-4708ea996d38/volumes"
Jul 10 23:32:57.076453 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.076387    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:32:57.076982 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.076757    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" podUID="7a28dd76-db38-4cbe-b94a-cc432888be02" containerName="maas-api" containerID="cri-o://5ce9c565b3ee38af4b179f39c84184a5a1b8670602a00bb111aec9bf15dec134" gracePeriod=30
Jul 10 23:32:57.467491 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.467456    2558 generic.go:356] "Generic (PLEG): container finished" podID="7a28dd76-db38-4cbe-b94a-cc432888be02" containerID="5ce9c565b3ee38af4b179f39c84184a5a1b8670602a00bb111aec9bf15dec134" exitCode=0
Jul 10 23:32:57.467677 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.467650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" event={"ID":"7a28dd76-db38-4cbe-b94a-cc432888be02","Type":"ContainerDied","Data":"5ce9c565b3ee38af4b179f39c84184a5a1b8670602a00bb111aec9bf15dec134"}
Jul 10 23:32:57.536550 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.536521    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:32:57.612282 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.612193    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca\") pod \"7a28dd76-db38-4cbe-b94a-cc432888be02\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") "
Jul 10 23:32:57.612282 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.612235    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") pod \"7a28dd76-db38-4cbe-b94a-cc432888be02\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") "
Jul 10 23:32:57.612282 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.612260    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sq7mk\" (UniqueName: \"kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk\") pod \"7a28dd76-db38-4cbe-b94a-cc432888be02\" (UID: \"7a28dd76-db38-4cbe-b94a-cc432888be02\") "
Jul 10 23:32:57.612917 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.612604    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a28dd76-db38-4cbe-b94a-cc432888be02" (UID: "7a28dd76-db38-4cbe-b94a-cc432888be02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:32:57.612917 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.612726    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a28dd76-db38-4cbe-b94a-cc432888be02-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:57.614669 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.614645    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a28dd76-db38-4cbe-b94a-cc432888be02" (UID: "7a28dd76-db38-4cbe-b94a-cc432888be02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:32:57.614669 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.614660    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk" (OuterVolumeSpecName: "kube-api-access-sq7mk") pod "7a28dd76-db38-4cbe-b94a-cc432888be02" (UID: "7a28dd76-db38-4cbe-b94a-cc432888be02"). InnerVolumeSpecName "kube-api-access-sq7mk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:32:57.713916 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.713881    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a28dd76-db38-4cbe-b94a-cc432888be02-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:57.713916 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:57.713915    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sq7mk\" (UniqueName: \"kubernetes.io/projected/7a28dd76-db38-4cbe-b94a-cc432888be02-kube-api-access-sq7mk\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:32:58.474163 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.474130    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"
Jul 10 23:32:58.474630 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.474160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf" event={"ID":"7a28dd76-db38-4cbe-b94a-cc432888be02","Type":"ContainerDied","Data":"e108e08119a8d3fea0b2ddddfbb81c478e517dca65cea350b0505ee7486a4042"}
Jul 10 23:32:58.474630 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.474224    2558 scope.go:117] "RemoveContainer" containerID="5ce9c565b3ee38af4b179f39c84184a5a1b8670602a00bb111aec9bf15dec134"
Jul 10 23:32:58.494517 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.494480    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:32:58.497742 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.497714    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-56040a-765dd7f689-bb4kf"]
Jul 10 23:32:58.541217 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:32:58.541192    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a28dd76-db38-4cbe-b94a-cc432888be02" path="/var/lib/kubelet/pods/7a28dd76-db38-4cbe-b94a-cc432888be02/volumes"
Jul 10 23:33:06.414791 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.414756    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:06.415229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415196    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="410d6327-0415-4c58-b238-4708ea996d38" containerName="main"
Jul 10 23:33:06.415229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415211    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="410d6327-0415-4c58-b238-4708ea996d38" containerName="main"
Jul 10 23:33:06.415229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415229    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a28dd76-db38-4cbe-b94a-cc432888be02" containerName="maas-api"
Jul 10 23:33:06.415334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415236    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a28dd76-db38-4cbe-b94a-cc432888be02" containerName="maas-api"
Jul 10 23:33:06.415334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415257    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" containerName="maas-api"
Jul 10 23:33:06.415334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415262    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" containerName="maas-api"
Jul 10 23:33:06.415334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415322    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="410d6327-0415-4c58-b238-4708ea996d38" containerName="main"
Jul 10 23:33:06.415334 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415330    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c25b41-6a51-4aa9-9bb7-6487c4558fab" containerName="maas-api"
Jul 10 23:33:06.415488 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.415337    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a28dd76-db38-4cbe-b94a-cc432888be02" containerName="maas-api"
Jul 10 23:33:06.420009 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.419982    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.422121 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.422098    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-7b4cfe-serving-cert\""
Jul 10 23:33:06.430865 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.430835    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:06.501558 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.501481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.501774 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.501690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrtt\" (UniqueName: \"kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.501845 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.501772    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.602912 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.602874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.603097 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.602930    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.603097 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.602993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrtt\" (UniqueName: \"kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.603494 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.603472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.605634 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.605617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.610829 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.610810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrtt\" (UniqueName: \"kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt\") pod \"maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.733199 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.733098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:06.885222 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:06.885196    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:06.887221 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:33:06.887176    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2d7e8d_84e7_4751_9620_96646621a14e.slice/crio-0a596d32d1da2be8a11e41ddc8b154c1040f38d5e62eefd180f421455f3c483c WatchSource:0}: Error finding container 0a596d32d1da2be8a11e41ddc8b154c1040f38d5e62eefd180f421455f3c483c: Status 404 returned error can't find the container with id 0a596d32d1da2be8a11e41ddc8b154c1040f38d5e62eefd180f421455f3c483c
Jul 10 23:33:07.526724 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:07.526622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" event={"ID":"df2d7e8d-84e7-4751-9620-96646621a14e","Type":"ContainerStarted","Data":"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"}
Jul 10 23:33:07.526724 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:07.526682    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" event={"ID":"df2d7e8d-84e7-4751-9620-96646621a14e","Type":"ContainerStarted","Data":"0a596d32d1da2be8a11e41ddc8b154c1040f38d5e62eefd180f421455f3c483c"}
Jul 10 23:33:07.527234 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:07.526727    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:07.545214 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:07.545165    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" podStartSLOduration=1.165908421 podStartE2EDuration="1.545148202s" totalImagesPullingTime="379.239781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:33:07.543402458 +0000 UTC m=+2233.518957461" watchObservedRunningTime="2026-07-10 23:33:07.545148202 +0000 UTC m=+2233.520703203"
Jul 10 23:33:13.537944 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:13.537913    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:27.870400 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:27.870303    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:27.870858 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:27.870603    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" podUID="df2d7e8d-84e7-4751-9620-96646621a14e" containerName="maas-api" containerID="cri-o://4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75" gracePeriod=30
Jul 10 23:33:28.126108 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.126010    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:28.212309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.212281    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls\") pod \"df2d7e8d-84e7-4751-9620-96646621a14e\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") "
Jul 10 23:33:28.212478 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.212319    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrtt\" (UniqueName: \"kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt\") pod \"df2d7e8d-84e7-4751-9620-96646621a14e\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") "
Jul 10 23:33:28.212478 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.212345    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca\") pod \"df2d7e8d-84e7-4751-9620-96646621a14e\" (UID: \"df2d7e8d-84e7-4751-9620-96646621a14e\") "
Jul 10 23:33:28.212756 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.212728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df2d7e8d-84e7-4751-9620-96646621a14e" (UID: "df2d7e8d-84e7-4751-9620-96646621a14e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:33:28.214480 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.214447    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt" (OuterVolumeSpecName: "kube-api-access-wrrtt") pod "df2d7e8d-84e7-4751-9620-96646621a14e" (UID: "df2d7e8d-84e7-4751-9620-96646621a14e"). InnerVolumeSpecName "kube-api-access-wrrtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:33:28.214599 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.214549    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df2d7e8d-84e7-4751-9620-96646621a14e" (UID: "df2d7e8d-84e7-4751-9620-96646621a14e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:33:28.313704 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.313669    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df2d7e8d-84e7-4751-9620-96646621a14e-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:33:28.313704 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.313699    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrtt\" (UniqueName: \"kubernetes.io/projected/df2d7e8d-84e7-4751-9620-96646621a14e-kube-api-access-wrrtt\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:33:28.313898 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.313715    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2d7e8d-84e7-4751-9620-96646621a14e-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:33:28.642707 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.642669    2558 generic.go:356] "Generic (PLEG): container finished" podID="df2d7e8d-84e7-4751-9620-96646621a14e" containerID="4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75" exitCode=0
Jul 10 23:33:28.642871 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.642717    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"
Jul 10 23:33:28.642871 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.642750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" event={"ID":"df2d7e8d-84e7-4751-9620-96646621a14e","Type":"ContainerDied","Data":"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"}
Jul 10 23:33:28.642871 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.642802    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6" event={"ID":"df2d7e8d-84e7-4751-9620-96646621a14e","Type":"ContainerDied","Data":"0a596d32d1da2be8a11e41ddc8b154c1040f38d5e62eefd180f421455f3c483c"}
Jul 10 23:33:28.642871 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.642825    2558 scope.go:117] "RemoveContainer" containerID="4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"
Jul 10 23:33:28.651662 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.651638    2558 scope.go:117] "RemoveContainer" containerID="4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"
Jul 10 23:33:28.651914 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:33:28.651895    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75\": container with ID starting with 4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75 not found: ID does not exist" containerID="4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"
Jul 10 23:33:28.651985 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.651921    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75"} err="failed to get container status \"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75\": rpc error: code = NotFound desc = could not find container \"4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75\": container with ID starting with 4915b83726c8b4629f141ac95dac0474f4a86610ef6a48352497ec300455ad75 not found: ID does not exist"
Jul 10 23:33:28.657729 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.657707    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:28.664780 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:28.664756    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-7b4cfe-774658dc74-gmmm6"]
Jul 10 23:33:30.541063 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:30.541026    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df2d7e8d-84e7-4751-9620-96646621a14e" path="/var/lib/kubelet/pods/df2d7e8d-84e7-4751-9620-96646621a14e/volumes"
Jul 10 23:33:43.789772 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.789734    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:33:43.790251 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.790196    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df2d7e8d-84e7-4751-9620-96646621a14e" containerName="maas-api"
Jul 10 23:33:43.790251 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.790210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="df2d7e8d-84e7-4751-9620-96646621a14e" containerName="maas-api"
Jul 10 23:33:43.790368 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.790277    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="df2d7e8d-84e7-4751-9620-96646621a14e" containerName="maas-api"
Jul 10 23:33:43.794843 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.794822    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.797134 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.797116    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f5848c-serving-cert\""
Jul 10 23:33:43.802650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.802252    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:33:43.863046 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.863002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.863223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.863051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc2p5\" (UniqueName: \"kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.863223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.863149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.964575 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.964530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.964738 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.964583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc2p5\" (UniqueName: \"kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.964738 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.964694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.965324 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.965300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.967468 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.967441    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:43.972928 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:43.972902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc2p5\" (UniqueName: \"kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5\") pod \"maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:44.106638 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.106549    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:44.254879 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.254852    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:33:44.256459 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:33:44.256426    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0fc57f0_fc15_44ff_8b62_da2c0ee75744.slice/crio-628bc4a2c7c45b808b8d4b8708bac3c0e17d20f3a7b5a2ddc8f2ffd10b473b10 WatchSource:0}: Error finding container 628bc4a2c7c45b808b8d4b8708bac3c0e17d20f3a7b5a2ddc8f2ffd10b473b10: Status 404 returned error can't find the container with id 628bc4a2c7c45b808b8d4b8708bac3c0e17d20f3a7b5a2ddc8f2ffd10b473b10
Jul 10 23:33:44.735851 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.735824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" event={"ID":"c0fc57f0-fc15-44ff-8b62-da2c0ee75744","Type":"ContainerStarted","Data":"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"}
Jul 10 23:33:44.736005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.735876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" event={"ID":"c0fc57f0-fc15-44ff-8b62-da2c0ee75744","Type":"ContainerStarted","Data":"628bc4a2c7c45b808b8d4b8708bac3c0e17d20f3a7b5a2ddc8f2ffd10b473b10"}
Jul 10 23:33:44.736005 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.735911    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:33:44.754441 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:44.754400    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" podStartSLOduration=1.357177129 podStartE2EDuration="1.754382818s" totalImagesPullingTime="397.205689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:33:44.753064096 +0000 UTC m=+2270.728619100" watchObservedRunningTime="2026-07-10 23:33:44.754382818 +0000 UTC m=+2270.729937851"
Jul 10 23:33:50.746412 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:33:50.746370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:34:06.512814 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.512777    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:34:06.517139 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.517118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.520724 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.520493    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"openshift-service-ca.crt\""
Jul 10 23:34:06.520724 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.520557    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"default-dockercfg-2ftxv\""
Jul 10 23:34:06.520724 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.520493    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"kube-root-ca.crt\""
Jul 10 23:34:06.521102 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.521078    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f5848c\"/\"auth-test-model-f5848c-kserve-self-signed-certs\""
Jul 10 23:34:06.523471 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.523446    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:34:06.678958 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.678917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.679179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.679070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.679179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.679143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.679179 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.679162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.679367 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.679297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.679367 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.679356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cb4t\" (UniqueName: \"kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.780657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.780657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780616    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.780657 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780631    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cb4t\" (UniqueName: \"kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781015 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.780775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781164 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.781130    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781308 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.781164    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.781308 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.781243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.783283 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.783252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.783579 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.783557    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.788490 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.788468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cb4t\" (UniqueName: \"kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t\") pod \"auth-test-model-f5848c-kserve-868cfcdc55-s75vj\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") " pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.828613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.828584    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:06.973923 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:06.973892    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:34:06.975260 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:34:06.975235    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47240b1b_c266_408a_8193_c68cc854d8f2.slice/crio-62b0dc543fcbadb8d7e7cb9ee3f87178fa5fc99b52d29a4c07ded01765c5b3a4 WatchSource:0}: Error finding container 62b0dc543fcbadb8d7e7cb9ee3f87178fa5fc99b52d29a4c07ded01765c5b3a4: Status 404 returned error can't find the container with id 62b0dc543fcbadb8d7e7cb9ee3f87178fa5fc99b52d29a4c07ded01765c5b3a4
Jul 10 23:34:07.869919 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:07.869877    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" event={"ID":"47240b1b-c266-408a-8193-c68cc854d8f2","Type":"ContainerStarted","Data":"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"}
Jul 10 23:34:07.870303 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:07.869929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" event={"ID":"47240b1b-c266-408a-8193-c68cc854d8f2","Type":"ContainerStarted","Data":"62b0dc543fcbadb8d7e7cb9ee3f87178fa5fc99b52d29a4c07ded01765c5b3a4"}
Jul 10 23:34:07.886406 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:07.886357    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" podStartSLOduration=1.8863390949999999 podStartE2EDuration="1.886339095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:34:07.884893238 +0000 UTC m=+2293.860448241" watchObservedRunningTime="2026-07-10 23:34:07.886339095 +0000 UTC m=+2293.861894096"
Jul 10 23:34:16.829180 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:16.829136    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:16.829180 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:16.829186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:16.841940 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:16.841915    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:34:16.935430 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:34:16.935399    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:35:54.970307 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:35:54.970276    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:35:54.977073 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:35:54.977053    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:36:49.163784 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:36:49.163746    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:37:04.186752 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.186714    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" podUID="47240b1b-c266-408a-8193-c68cc854d8f2" containerName="main" containerID="cri-o://f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b" gracePeriod=45
Jul 10 23:37:04.449881 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.449803    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:37:04.470218 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470188    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470373 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470253    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470373 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470319    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cb4t\" (UniqueName: \"kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470476 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470391    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470476 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470432    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470619 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470490    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs\") pod \"47240b1b-c266-408a-8193-c68cc854d8f2\" (UID: \"47240b1b-c266-408a-8193-c68cc854d8f2\") "
Jul 10 23:37:04.470619 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home" (OuterVolumeSpecName: "home") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:37:04.471031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470722    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:37:04.471031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:37:04.471031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470974    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-model-cache\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.471031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.470994    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-tmp-dir\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.471031 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.471007    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-home\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.473529 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.473463    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm" (OuterVolumeSpecName: "dshm") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:37:04.473652 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.473530    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t" (OuterVolumeSpecName: "kube-api-access-2cb4t") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "kube-api-access-2cb4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:37:04.473652 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.473588    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "47240b1b-c266-408a-8193-c68cc854d8f2" (UID: "47240b1b-c266-408a-8193-c68cc854d8f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:37:04.572008 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.571969    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47240b1b-c266-408a-8193-c68cc854d8f2-tls-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.572008 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.571999    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47240b1b-c266-408a-8193-c68cc854d8f2-dshm\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.572221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.572019    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cb4t\" (UniqueName: \"kubernetes.io/projected/47240b1b-c266-408a-8193-c68cc854d8f2-kube-api-access-2cb4t\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:37:04.839239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.839146    2558 generic.go:356] "Generic (PLEG): container finished" podID="47240b1b-c266-408a-8193-c68cc854d8f2" containerID="f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b" exitCode=0
Jul 10 23:37:04.839239 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.839203    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"
Jul 10 23:37:04.839427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.839239    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" event={"ID":"47240b1b-c266-408a-8193-c68cc854d8f2","Type":"ContainerDied","Data":"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"}
Jul 10 23:37:04.839427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.839286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj" event={"ID":"47240b1b-c266-408a-8193-c68cc854d8f2","Type":"ContainerDied","Data":"62b0dc543fcbadb8d7e7cb9ee3f87178fa5fc99b52d29a4c07ded01765c5b3a4"}
Jul 10 23:37:04.839427 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.839307    2558 scope.go:117] "RemoveContainer" containerID="f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"
Jul 10 23:37:04.848894 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.848873    2558 scope.go:117] "RemoveContainer" containerID="f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"
Jul 10 23:37:04.849223 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:37:04.849203    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b\": container with ID starting with f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b not found: ID does not exist" containerID="f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"
Jul 10 23:37:04.849292 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.849235    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b"} err="failed to get container status \"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b\": rpc error: code = NotFound desc = could not find container \"f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b\": container with ID starting with f357a5d62b22000df6709a145bcb914ba9748cae5370250ef38ae25424cd9a9b not found: ID does not exist"
Jul 10 23:37:04.854781 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.854751    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:37:04.859684 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:04.859658    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f5848c/auth-test-model-f5848c-kserve-868cfcdc55-s75vj"]
Jul 10 23:37:06.540941 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:06.540908    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47240b1b-c266-408a-8193-c68cc854d8f2" path="/var/lib/kubelet/pods/47240b1b-c266-408a-8193-c68cc854d8f2/volumes"
Jul 10 23:37:51.320037 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.319535    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:37:51.320616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.320235    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47240b1b-c266-408a-8193-c68cc854d8f2" containerName="main"
Jul 10 23:37:51.320616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.320258    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="47240b1b-c266-408a-8193-c68cc854d8f2" containerName="main"
Jul 10 23:37:51.320616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.320373    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="47240b1b-c266-408a-8193-c68cc854d8f2" containerName="main"
Jul 10 23:37:51.323770 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.323735    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.327425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.327404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"kube-root-ca.crt\""
Jul 10 23:37:51.327425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.327419    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"sub-test-model-27111a-kserve-self-signed-certs\""
Jul 10 23:37:51.327641 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.327456    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"default-dockercfg-9hj8q\""
Jul 10 23:37:51.327641 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.327632    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"openshift-service-ca.crt\""
Jul 10 23:37:51.336715 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.336693    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:37:51.496864 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.496825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.497039 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.496950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.497039 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.497030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.497124 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.497087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.497124 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.497108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.497193 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.497124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29mzx\" (UniqueName: \"kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598322 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598322 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598397    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29mzx\" (UniqueName: \"kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598554 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598720 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598795 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.598876 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.599014 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.598992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.600895 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.600867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.601027 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.601009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.606429 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.606405    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29mzx\" (UniqueName: \"kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx\") pod \"sub-test-model-27111a-kserve-68ccdf647c-68zcl\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") " pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.633258 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.633232    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:37:51.771099 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:51.771073    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:37:51.773225 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:37:51.773200    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9ede7c5_9a7a_4419_9174_64b80ee2543a.slice/crio-6c8e65d566c3f0ec5fb1837df8aa3b6ffd103a1379fd209a8d8fde2f0bbcfde6 WatchSource:0}: Error finding container 6c8e65d566c3f0ec5fb1837df8aa3b6ffd103a1379fd209a8d8fde2f0bbcfde6: Status 404 returned error can't find the container with id 6c8e65d566c3f0ec5fb1837df8aa3b6ffd103a1379fd209a8d8fde2f0bbcfde6
Jul 10 23:37:52.088276 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:52.088235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" event={"ID":"a9ede7c5-9a7a-4419-9174-64b80ee2543a","Type":"ContainerStarted","Data":"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"}
Jul 10 23:37:52.088276 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:52.088275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" event={"ID":"a9ede7c5-9a7a-4419-9174-64b80ee2543a","Type":"ContainerStarted","Data":"6c8e65d566c3f0ec5fb1837df8aa3b6ffd103a1379fd209a8d8fde2f0bbcfde6"}
Jul 10 23:37:52.103318 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:37:52.103274    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" podStartSLOduration=1.103258845 podStartE2EDuration="1.103258845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:37:52.101883429 +0000 UTC m=+2518.077438431" watchObservedRunningTime="2026-07-10 23:37:52.103258845 +0000 UTC m=+2518.078813846"
Jul 10 23:38:01.633530 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:01.633446    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:01.633972 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:01.633571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:01.646748 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:01.646720    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:02.151425 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:02.151398    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:39.009012 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:39.008979    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:38:54.032569 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.032523    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" podUID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" containerName="main" containerID="cri-o://0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2" gracePeriod=45
Jul 10 23:38:54.292718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.292661    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:54.388070 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388027    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29mzx\" (UniqueName: \"kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388083    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388119    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388143    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388232    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388463 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388288    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache\") pod \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\" (UID: \"a9ede7c5-9a7a-4419-9174-64b80ee2543a\") "
Jul 10 23:38:54.388463 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388320    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:38:54.388463 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388442    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home" (OuterVolumeSpecName: "home") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:38:54.388683 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388665    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tmp-dir\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.388742 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388668    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache" (OuterVolumeSpecName: "model-cache") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:38:54.388742 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.388684    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-home\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.390513 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.390478    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm" (OuterVolumeSpecName: "dshm") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:38:54.390603 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.390519    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx" (OuterVolumeSpecName: "kube-api-access-29mzx") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "kube-api-access-29mzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:38:54.390603 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.390567    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a9ede7c5-9a7a-4419-9174-64b80ee2543a" (UID: "a9ede7c5-9a7a-4419-9174-64b80ee2543a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:38:54.420819 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.420755    2558 generic.go:356] "Generic (PLEG): container finished" podID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" containerID="0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2" exitCode=0
Jul 10 23:38:54.420984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.420854    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"
Jul 10 23:38:54.420984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.420883    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" event={"ID":"a9ede7c5-9a7a-4419-9174-64b80ee2543a","Type":"ContainerDied","Data":"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"}
Jul 10 23:38:54.420984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.420931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl" event={"ID":"a9ede7c5-9a7a-4419-9174-64b80ee2543a","Type":"ContainerDied","Data":"6c8e65d566c3f0ec5fb1837df8aa3b6ffd103a1379fd209a8d8fde2f0bbcfde6"}
Jul 10 23:38:54.420984 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.420948    2558 scope.go:117] "RemoveContainer" containerID="0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"
Jul 10 23:38:54.430611 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.430592    2558 scope.go:117] "RemoveContainer" containerID="0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"
Jul 10 23:38:54.430912 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:38:54.430890    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2\": container with ID starting with 0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2 not found: ID does not exist" containerID="0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"
Jul 10 23:38:54.431020 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.430918    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2"} err="failed to get container status \"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2\": rpc error: code = NotFound desc = could not find container \"0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2\": container with ID starting with 0cd6e17fd6e615ea5f3ef2e6cb0f13b170655222d071736fceadd86f55b58cb2 not found: ID does not exist"
Jul 10 23:38:54.441426 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.441403    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:38:54.443468 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.443450    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/sub-test-model-27111a-kserve-68ccdf647c-68zcl"]
Jul 10 23:38:54.489254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.489219    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ede7c5-9a7a-4419-9174-64b80ee2543a-tls-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.489254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.489245    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-model-cache\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.489254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.489255    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29mzx\" (UniqueName: \"kubernetes.io/projected/a9ede7c5-9a7a-4419-9174-64b80ee2543a-kube-api-access-29mzx\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.489254 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.489263    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a9ede7c5-9a7a-4419-9174-64b80ee2543a-dshm\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:38:54.541146 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:38:54.541114    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" path="/var/lib/kubelet/pods/a9ede7c5-9a7a-4419-9174-64b80ee2543a/volumes"
Jul 10 23:39:01.218405 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.218354    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:39:01.218832 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.218817    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" containerName="main"
Jul 10 23:39:01.218879 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.218836    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" containerName="main"
Jul 10 23:39:01.218927 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.218915    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9ede7c5-9a7a-4419-9174-64b80ee2543a" containerName="main"
Jul 10 23:39:01.222029 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.222009    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.225081 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.225045    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"kube-root-ca.crt\""
Jul 10 23:39:01.225081 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.225080    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"default-dockercfg-9hj8q\""
Jul 10 23:39:01.225279 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.225080    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"openshift-service-ca.crt\""
Jul 10 23:39:01.225331 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.225320    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-27111a\"/\"rate-test-model-27111a-kserve-self-signed-certs\""
Jul 10 23:39:01.232193 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.232165    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:39:01.355350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.355350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.355667 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.355667 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.355667 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnj9t\" (UniqueName: \"kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.355667 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.355608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456299 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456261    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456519 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456308    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnj9t\" (UniqueName: \"kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456519 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456345    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456519 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456519 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456764 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456764 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456713    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.456874 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.457017 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.456990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.458953 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.458925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.459200 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.459184    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.463942 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.463919    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnj9t\" (UniqueName: \"kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t\") pod \"rate-test-model-27111a-kserve-665f8564c5-dzphg\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") " pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.534046 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.533950    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:01.678091 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:01.678067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:39:01.680175 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:39:01.680143    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0260fab_efac_42f3_8ffb_814d2f5ebf66.slice/crio-bd815ac4d239e32500246e19c935bceec77f325fd4e64020e009651fe160e927 WatchSource:0}: Error finding container bd815ac4d239e32500246e19c935bceec77f325fd4e64020e009651fe160e927: Status 404 returned error can't find the container with id bd815ac4d239e32500246e19c935bceec77f325fd4e64020e009651fe160e927
Jul 10 23:39:02.466250 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:02.466203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" event={"ID":"d0260fab-efac-42f3-8ffb-814d2f5ebf66","Type":"ContainerStarted","Data":"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"}
Jul 10 23:39:02.466718 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:02.466261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" event={"ID":"d0260fab-efac-42f3-8ffb-814d2f5ebf66","Type":"ContainerStarted","Data":"bd815ac4d239e32500246e19c935bceec77f325fd4e64020e009651fe160e927"}
Jul 10 23:39:02.482290 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:02.482240    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" podStartSLOduration=1.482212681 podStartE2EDuration="1.482212681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:39:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:39:02.480871565 +0000 UTC m=+2588.456426567" watchObservedRunningTime="2026-07-10 23:39:02.482212681 +0000 UTC m=+2588.457767683"
Jul 10 23:39:11.534154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:11.534112    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:11.534154 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:11.534163    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:11.546679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:11.546652    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:12.548896 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:12.548866    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:39:56.206964 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:39:56.206932    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:40:11.228245 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.228187    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" podUID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" containerName="main" containerID="cri-o://060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528" gracePeriod=45
Jul 10 23:40:11.482393 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.482332    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:40:11.529030 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.528988    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529051    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529114    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529148    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529221 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529210    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnj9t\" (UniqueName: \"kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529240    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm\") pod \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\" (UID: \"d0260fab-efac-42f3-8ffb-814d2f5ebf66\") "
Jul 10 23:40:11.529548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529294    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:40:11.529548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home" (OuterVolumeSpecName: "home") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:40:11.529548 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:40:11.529777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529634    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-home\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.529777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529652    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-model-cache\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.529777 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.529667    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tmp-dir\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.531472 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.531445    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t" (OuterVolumeSpecName: "kube-api-access-hnj9t") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "kube-api-access-hnj9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:40:11.531610 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.531470    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm" (OuterVolumeSpecName: "dshm") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:40:11.531610 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.531474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0260fab-efac-42f3-8ffb-814d2f5ebf66" (UID: "d0260fab-efac-42f3-8ffb-814d2f5ebf66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:40:11.630375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.630335    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0260fab-efac-42f3-8ffb-814d2f5ebf66-tls-certs\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.630375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.630366    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnj9t\" (UniqueName: \"kubernetes.io/projected/d0260fab-efac-42f3-8ffb-814d2f5ebf66-kube-api-access-hnj9t\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.630375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.630376    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0260fab-efac-42f3-8ffb-814d2f5ebf66-dshm\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:11.858679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.858587    2558 generic.go:356] "Generic (PLEG): container finished" podID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" containerID="060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528" exitCode=0
Jul 10 23:40:11.858679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.858627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" event={"ID":"d0260fab-efac-42f3-8ffb-814d2f5ebf66","Type":"ContainerDied","Data":"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"}
Jul 10 23:40:11.858679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.858631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"
Jul 10 23:40:11.858679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.858660    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg" event={"ID":"d0260fab-efac-42f3-8ffb-814d2f5ebf66","Type":"ContainerDied","Data":"bd815ac4d239e32500246e19c935bceec77f325fd4e64020e009651fe160e927"}
Jul 10 23:40:11.858679 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.858681    2558 scope.go:117] "RemoveContainer" containerID="060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"
Jul 10 23:40:11.874419 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.874400    2558 scope.go:117] "RemoveContainer" containerID="060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"
Jul 10 23:40:11.874720 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:40:11.874699    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528\": container with ID starting with 060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528 not found: ID does not exist" containerID="060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"
Jul 10 23:40:11.874799 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.874732    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528"} err="failed to get container status \"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528\": rpc error: code = NotFound desc = could not find container \"060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528\": container with ID starting with 060f697d4bc96d53b45f1eded206aa5c7f177f570b45d42bdf4c597a374d7528 not found: ID does not exist"
Jul 10 23:40:11.883932 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.883902    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:40:11.886061 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:11.886036    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-27111a/rate-test-model-27111a-kserve-665f8564c5-dzphg"]
Jul 10 23:40:12.394238 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.394189    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"]
Jul 10 23:40:12.394830 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.394810    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" containerName="main"
Jul 10 23:40:12.394916 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.394833    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" containerName="main"
Jul 10 23:40:12.394970 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.394947    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" containerName="main"
Jul 10 23:40:12.399309 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.399289    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:12.401012 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.400979    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"]
Jul 10 23:40:12.401357 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.401341    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xdkqz\""
Jul 10 23:40:12.437727 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.437693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhnpd\" (UniqueName: \"kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd\") pod \"test-curl-7459-140572291584480\" (UID: \"99587580-c411-445d-b1f1-ef6fc44f870f\") " pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:12.538294 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.538253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhnpd\" (UniqueName: \"kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd\") pod \"test-curl-7459-140572291584480\" (UID: \"99587580-c411-445d-b1f1-ef6fc44f870f\") " pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:12.540105 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.540082    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0260fab-efac-42f3-8ffb-814d2f5ebf66" path="/var/lib/kubelet/pods/d0260fab-efac-42f3-8ffb-814d2f5ebf66/volumes"
Jul 10 23:40:12.545803 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.545784    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhnpd\" (UniqueName: \"kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd\") pod \"test-curl-7459-140572291584480\" (UID: \"99587580-c411-445d-b1f1-ef6fc44f870f\") " pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:12.709429 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.709352    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:12.845674 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.845642    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"]
Jul 10 23:40:12.846862 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:40:12.846838    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99587580_c411_445d_b1f1_ef6fc44f870f.slice/crio-866f31455b2c61b0a9764fe06ff41a2958831fdf6cb7fe793f99b258f2410f20 WatchSource:0}: Error finding container 866f31455b2c61b0a9764fe06ff41a2958831fdf6cb7fe793f99b258f2410f20: Status 404 returned error can't find the container with id 866f31455b2c61b0a9764fe06ff41a2958831fdf6cb7fe793f99b258f2410f20
Jul 10 23:40:12.848295 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.848275    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:40:12.871561 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:12.871525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291584480" event={"ID":"99587580-c411-445d-b1f1-ef6fc44f870f","Type":"ContainerStarted","Data":"866f31455b2c61b0a9764fe06ff41a2958831fdf6cb7fe793f99b258f2410f20"}
Jul 10 23:40:13.878286 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:13.878197    2558 generic.go:356] "Generic (PLEG): container finished" podID="99587580-c411-445d-b1f1-ef6fc44f870f" containerID="583969c2f81e3c758a9c5d37e58231c942b4db0446930e73400459926e33c779" exitCode=0
Jul 10 23:40:13.878286 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:13.878235    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7459-140572291584480" event={"ID":"99587580-c411-445d-b1f1-ef6fc44f870f","Type":"ContainerDied","Data":"583969c2f81e3c758a9c5d37e58231c942b4db0446930e73400459926e33c779"}
Jul 10 23:40:15.026529 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.026485    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:15.059759 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.059731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7459-140572291584480_99587580-c411-445d-b1f1-ef6fc44f870f/test-curl-7459-140572291584480/0.log"
Jul 10 23:40:15.063008 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.062982    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhnpd\" (UniqueName: \"kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd\") pod \"99587580-c411-445d-b1f1-ef6fc44f870f\" (UID: \"99587580-c411-445d-b1f1-ef6fc44f870f\") "
Jul 10 23:40:15.065229 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.065201    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd" (OuterVolumeSpecName: "kube-api-access-nhnpd") pod "99587580-c411-445d-b1f1-ef6fc44f870f" (UID: "99587580-c411-445d-b1f1-ef6fc44f870f"). InnerVolumeSpecName "kube-api-access-nhnpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:40:15.083202 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.083175    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"]
Jul 10 23:40:15.086539 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.086517    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7459-140572291584480"]
Jul 10 23:40:15.164644 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.164607    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhnpd\" (UniqueName: \"kubernetes.io/projected/99587580-c411-445d-b1f1-ef6fc44f870f-kube-api-access-nhnpd\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:15.889592 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.889560    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="866f31455b2c61b0a9764fe06ff41a2958831fdf6cb7fe793f99b258f2410f20"
Jul 10 23:40:15.889592 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.889589    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:15.898911 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:40:15.898885    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7459-140572291584480\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:15.993153 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.993109    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:40:15.993446 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:15.993403    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" podUID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" containerName="maas-api" containerID="cri-o://059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23" gracePeriod=30
Jul 10 23:40:16.010901 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:40:16.010867    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7459-140572291584480\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:16.246346 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.246320    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:40:16.264571 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:40:16.264410    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7459-140572291584480\" is forbidden: User \"system:node:ip-10-0-139-179.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-179.ec2.internal' and this object" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" pod="openshift-ingress/test-curl-7459-140572291584480"
Jul 10 23:40:16.273968 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.273943    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc2p5\" (UniqueName: \"kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5\") pod \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") "
Jul 10 23:40:16.274105 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.274039    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca\") pod \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") "
Jul 10 23:40:16.274168 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.274138    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls\") pod \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\" (UID: \"c0fc57f0-fc15-44ff-8b62-da2c0ee75744\") "
Jul 10 23:40:16.274447 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.274408    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c0fc57f0-fc15-44ff-8b62-da2c0ee75744" (UID: "c0fc57f0-fc15-44ff-8b62-da2c0ee75744"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 23:40:16.274702 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.274681    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-openshift-service-ca\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:16.276549 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.276528    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c0fc57f0-fc15-44ff-8b62-da2c0ee75744" (UID: "c0fc57f0-fc15-44ff-8b62-da2c0ee75744"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:40:16.276772 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.276755    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5" (OuterVolumeSpecName: "kube-api-access-cc2p5") pod "c0fc57f0-fc15-44ff-8b62-da2c0ee75744" (UID: "c0fc57f0-fc15-44ff-8b62-da2c0ee75744"). InnerVolumeSpecName "kube-api-access-cc2p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:40:16.375536 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.375483    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc2p5\" (UniqueName: \"kubernetes.io/projected/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-kube-api-access-cc2p5\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:16.375536 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.375532    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c0fc57f0-fc15-44ff-8b62-da2c0ee75744-maas-api-tls\") on node \"ip-10-0-139-179.ec2.internal\" DevicePath \"\""
Jul 10 23:40:16.546120 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.546039    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" path="/var/lib/kubelet/pods/99587580-c411-445d-b1f1-ef6fc44f870f/volumes"
Jul 10 23:40:16.896011 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.895978    2558 generic.go:356] "Generic (PLEG): container finished" podID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" containerID="059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23" exitCode=0
Jul 10 23:40:16.896011 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.896015    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" event={"ID":"c0fc57f0-fc15-44ff-8b62-da2c0ee75744","Type":"ContainerDied","Data":"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"}
Jul 10 23:40:16.896236 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.896034    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"
Jul 10 23:40:16.896236 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.896068    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m" event={"ID":"c0fc57f0-fc15-44ff-8b62-da2c0ee75744","Type":"ContainerDied","Data":"628bc4a2c7c45b808b8d4b8708bac3c0e17d20f3a7b5a2ddc8f2ffd10b473b10"}
Jul 10 23:40:16.896236 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.896092    2558 scope.go:117] "RemoveContainer" containerID="059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"
Jul 10 23:40:16.905198 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.905179    2558 scope.go:117] "RemoveContainer" containerID="059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"
Jul 10 23:40:16.905452 ip-10-0-139-179 kubenswrapper[2558]: E0710 23:40:16.905432    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23\": container with ID starting with 059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23 not found: ID does not exist" containerID="059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"
Jul 10 23:40:16.905540 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.905462    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23"} err="failed to get container status \"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23\": rpc error: code = NotFound desc = could not find container \"059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23\": container with ID starting with 059a59fbf6ca78a14fb20ff04f94dc417d454cc78ca5447a6d4bfced8d719a23 not found: ID does not exist"
Jul 10 23:40:16.911599 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.911576    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:40:16.916492 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:16.916472    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f5848c-644476bd8-fqg4m"]
Jul 10 23:40:18.540375 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:18.540345    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" path="/var/lib/kubelet/pods/c0fc57f0-fc15-44ff-8b62-da2c0ee75744/volumes"
Jul 10 23:40:34.288629 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.288597    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vtr5t_a7d53e3a-bfd2-4033-9c95-64caa9ddb165/manager/0.log"
Jul 10 23:40:34.411676 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.411645    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gvpxv_074262a2-d77a-4e42-90f3-9082b3cf94c0/manager/0.log"
Jul 10 23:40:34.539241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.539152    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86cc69d557-vxrbm_25c36620-b174-4854-b486-8f39a8a6d772/manager/0.log"
Jul 10 23:40:34.660834 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.660795    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltssw_21f4a97f-0520-42f2-9222-11870c30ef78/server/0.log"
Jul 10 23:40:34.784898 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.784871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g8ctf_88df527e-e2a7-4f82-a846-f75ac7c9ed21/manager/0.log"
Jul 10 23:40:34.909078 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.909046    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-gqhvw_32772ee7-e155-4495-9cbd-9a746cfa88be/manager/0.log"
Jul 10 23:40:34.916181 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:34.916156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-gqhvw_32772ee7-e155-4495-9cbd-9a746cfa88be/copy-manifests/0.log"
Jul 10 23:40:35.548695 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:35.548663    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-85cc7c6cfb-nn826_7c2bb2cc-8e55-40f1-b329-8116f5fa8977/maas-api/0.log"
Jul 10 23:40:35.671693 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:35.671659    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nzqdm_f80c5d41-536e-486c-af38-cab2b48e720c/postgres/0.log"
Jul 10 23:40:36.494622 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.494592    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/util/0.log"
Jul 10 23:40:36.501350 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.501326    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/pull/0.log"
Jul 10 23:40:36.508129 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.508109    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/extract/0.log"
Jul 10 23:40:36.630635 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.630600    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/util/0.log"
Jul 10 23:40:36.637408 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.637382    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/pull/0.log"
Jul 10 23:40:36.644336 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.644312    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/extract/0.log"
Jul 10 23:40:36.765531 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.765435    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/extract/0.log"
Jul 10 23:40:36.771588 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.771563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/util/0.log"
Jul 10 23:40:36.778193 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.778172    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/pull/0.log"
Jul 10 23:40:36.895722 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.895695    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/util/0.log"
Jul 10 23:40:36.901639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.901616    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/pull/0.log"
Jul 10 23:40:36.907310 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:36.907291    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/extract/0.log"
Jul 10 23:40:37.163823 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:37.163791    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jsg9p_d732f700-8218-4129-950d-cd8ffb8ca053/manager/0.log"
Jul 10 23:40:37.283142 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:37.283116    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cp5cc_ce5ec8a7-d7c7-487b-bef8-c5db85705ecc/manager/0.log"
Jul 10 23:40:37.400453 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:37.400425    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rnlwx_039c16dc-d656-4159-9430-6702991cf39c/kuadrant-console-plugin/0.log"
Jul 10 23:40:37.529887 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:37.529810    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9qdd_c0c007f7-123d-43ec-ac8f-d6fb8a5a630b/registry-server/0.log"
Jul 10 23:40:37.661553 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:37.661517    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qs7vt_c697ceb5-aa73-4040-b337-561e77f4cab9/manager/0.log"
Jul 10 23:40:38.291683 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:38.291653    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nkzkw_ba5a5ff4-700d-4b7d-9e92-d8e4f819c687/istio-proxy/0.log"
Jul 10 23:40:38.545563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:38.545478    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7947c57c45-77dnm_831a6973-f36c-424f-be85-d3bfa988869e/kube-auth-proxy/0.log"
Jul 10 23:40:38.809129 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:38.809050    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/1.log"
Jul 10 23:40:38.933650 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:38.933624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-49f96_e53fb6ae-e83d-4150-b471-732410b13d71/payload-pre-processing/0.log"
Jul 10 23:40:39.058541 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:39.058512    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rtjsk_933ee89a-c40f-46ad-ba82-318295f6a2ae/payload-processing/0.log"
Jul 10 23:40:39.659787 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:39.659762    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mjm6q_4b6088a2-8b28-4261-a9e1-ea8953c480ce/main/0.log"
Jul 10 23:40:39.902145 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:39.902111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db78d2q_23ed38fb-22ce-47e3-ad2f-8adb6280f622/main/0.log"
Jul 10 23:40:40.017588 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:40.017515    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9kt5c_54e3642e-9bf6-492d-8d01-bfb3502a29f7/main/0.log"
Jul 10 23:40:47.196907 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:47.196823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j5k76_4e866937-5439-47a5-9207-03bf8201b071/global-pull-secret-syncer/0.log"
Jul 10 23:40:47.278040 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:47.278009    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lkmb6_39934efb-f10a-420f-8ab5-c87ca3290580/konnectivity-agent/0.log"
Jul 10 23:40:47.361787 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:47.361754    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-179.ec2.internal_15eaeba84a5e31eea246ffc0b85b1644/haproxy/0.log"
Jul 10 23:40:51.868725 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:51.868692    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/extract/0.log"
Jul 10 23:40:51.888359 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:51.888335    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/util/0.log"
Jul 10 23:40:51.941545 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:51.941514    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759h2rjt_958d9dd1-e48d-4778-98cb-bb0518a5b943/pull/0.log"
Jul 10 23:40:51.965738 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:51.965713    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/extract/0.log"
Jul 10 23:40:51.987025 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:51.987004    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/util/0.log"
Jul 10 23:40:52.007059 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.007043    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0rq8n8_a827cf33-763e-4632-9c32-9f118f65ba58/pull/0.log"
Jul 10 23:40:52.033046 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.033025    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/extract/0.log"
Jul 10 23:40:52.058770 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.058749    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/util/0.log"
Jul 10 23:40:52.078151 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.078128    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73md94p_821f1a6b-974e-48fa-bed3-0f3c5a440277/pull/0.log"
Jul 10 23:40:52.110490 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.110465    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/extract/0.log"
Jul 10 23:40:52.133979 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.133919    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/util/0.log"
Jul 10 23:40:52.152963 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.152947    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ctlwn_709dd745-71f6-44cc-ab18-d647a6d007b5/pull/0.log"
Jul 10 23:40:52.543342 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.543317    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jsg9p_d732f700-8218-4129-950d-cd8ffb8ca053/manager/0.log"
Jul 10 23:40:52.569445 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.569424    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cp5cc_ce5ec8a7-d7c7-487b-bef8-c5db85705ecc/manager/0.log"
Jul 10 23:40:52.599616 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.599596    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rnlwx_039c16dc-d656-4159-9430-6702991cf39c/kuadrant-console-plugin/0.log"
Jul 10 23:40:52.643876 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.643852    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p9qdd_c0c007f7-123d-43ec-ac8f-d6fb8a5a630b/registry-server/0.log"
Jul 10 23:40:52.791469 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:52.791437    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qs7vt_c697ceb5-aa73-4040-b337-561e77f4cab9/manager/0.log"
Jul 10 23:40:54.760639 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:54.760612    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4thzz_b266fcdc-598f-4f9a-b5d0-58b5eebbd723/node-exporter/0.log"
Jul 10 23:40:54.781904 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:54.781877    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4thzz_b266fcdc-598f-4f9a-b5d0-58b5eebbd723/kube-rbac-proxy/0.log"
Jul 10 23:40:54.803359 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:54.803337    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4thzz_b266fcdc-598f-4f9a-b5d0-58b5eebbd723/init-textfile/0.log"
Jul 10 23:40:55.009879 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:55.009722    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:40:55.021596 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:55.018476    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:40:55.335992 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:55.335919    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-758497588f-4dzg5_cac288e9-6b6a-4d4a-b278-302f8737c8a0/telemeter-client/0.log"
Jul 10 23:40:55.358612 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:55.358587    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-758497588f-4dzg5_cac288e9-6b6a-4d4a-b278-302f8737c8a0/reload/0.log"
Jul 10 23:40:55.379054 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:55.379032    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-758497588f-4dzg5_cac288e9-6b6a-4d4a-b278-302f8737c8a0/kube-rbac-proxy/0.log"
Jul 10 23:40:58.063435 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.063402    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-845575b679-ck8m5_8caa5191-706d-4fe7-ad3d-7f8c3cee4053/console/0.log"
Jul 10 23:40:58.273038 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.272991    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"]
Jul 10 23:40:58.273454 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273440    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" containerName="maas-api"
Jul 10 23:40:58.273515 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273456    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" containerName="maas-api"
Jul 10 23:40:58.273515 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273473    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" containerName="test-curl-7459-140572291584480"
Jul 10 23:40:58.273515 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273480    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" containerName="test-curl-7459-140572291584480"
Jul 10 23:40:58.273613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273558    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0fc57f0-fc15-44ff-8b62-da2c0ee75744" containerName="maas-api"
Jul 10 23:40:58.273613 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.273567    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="99587580-c411-445d-b1f1-ef6fc44f870f" containerName="test-curl-7459-140572291584480"
Jul 10 23:40:58.276661 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.276639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.278891 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.278868    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjdll\"/\"openshift-service-ca.crt\""
Jul 10 23:40:58.279722 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.279705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pjdll\"/\"default-dockercfg-8j987\""
Jul 10 23:40:58.279803 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.279710    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pjdll\"/\"kube-root-ca.crt\""
Jul 10 23:40:58.284603 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.284576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"]
Jul 10 23:40:58.374060 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.373973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-sys\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.374060 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.374034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8fs\" (UniqueName: \"kubernetes.io/projected/488951e4-9941-4173-8659-39cb052de0ff-kube-api-access-5q8fs\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.374235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.374084    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-podres\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.374235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.374142    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-lib-modules\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.374235 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.374168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-proc\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.474972 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.474939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-sys\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.474972 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.474973    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8fs\" (UniqueName: \"kubernetes.io/projected/488951e4-9941-4173-8659-39cb052de0ff-kube-api-access-5q8fs\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.474998    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-podres\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-lib-modules\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475068    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-proc\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-podres\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475071    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-sys\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475177 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-proc\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.475406 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.475166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/488951e4-9941-4173-8659-39cb052de0ff-lib-modules\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.484759 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.484737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8fs\" (UniqueName: \"kubernetes.io/projected/488951e4-9941-4173-8659-39cb052de0ff-kube-api-access-5q8fs\") pod \"perf-node-gather-daemonset-zjrtc\" (UID: \"488951e4-9941-4173-8659-39cb052de0ff\") " pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.587694 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.587653    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:58.723690 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:58.723655    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"]
Jul 10 23:40:58.727085 ip-10-0-139-179 kubenswrapper[2558]: W0710 23:40:58.727058    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod488951e4_9941_4173_8659_39cb052de0ff.slice/crio-add9db44f77df8274e2bf080fda36459e84de679b48f05c5b6ba586f642ec247 WatchSource:0}: Error finding container add9db44f77df8274e2bf080fda36459e84de679b48f05c5b6ba586f642ec247: Status 404 returned error can't find the container with id add9db44f77df8274e2bf080fda36459e84de679b48f05c5b6ba586f642ec247
Jul 10 23:40:59.115563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.115444    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc" event={"ID":"488951e4-9941-4173-8659-39cb052de0ff","Type":"ContainerStarted","Data":"c0ecc685edc43e7037bc8c277f4377c8d4290c825509c9dcd2c3abf8beb1c759"}
Jul 10 23:40:59.115563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.115514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc" event={"ID":"488951e4-9941-4173-8659-39cb052de0ff","Type":"ContainerStarted","Data":"add9db44f77df8274e2bf080fda36459e84de679b48f05c5b6ba586f642ec247"}
Jul 10 23:40:59.115563 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.115537    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:40:59.132410 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.132365    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc" podStartSLOduration=1.132351943 podStartE2EDuration="1.132351943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 23:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:40:59.130771347 +0000 UTC m=+2705.106326352" watchObservedRunningTime="2026-07-10 23:40:59.132351943 +0000 UTC m=+2705.107906945"
Jul 10 23:40:59.845298 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.845269    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dgzv_14f360c4-9f10-4f2b-97ad-29e5bbfa9776/dns/0.log"
Jul 10 23:40:59.865042 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.865022    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8dgzv_14f360c4-9f10-4f2b-97ad-29e5bbfa9776/kube-rbac-proxy/0.log"
Jul 10 23:40:59.967950 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:40:59.967929    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqxf5_7733a223-4659-44bc-ae47-cffa19cd73a5/dns-node-resolver/0.log"
Jul 10 23:41:00.518123 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:00.518098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76c7469587-zq4bw_446d09d2-443a-4822-8a60-67f329b9ca6b/registry/0.log"
Jul 10 23:41:00.584815 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:00.584779    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tbm25_583e521c-b87f-48e6-a8b3-6e0efe654ea4/node-ca/0.log"
Jul 10 23:41:01.486703 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.486666    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nkzkw_ba5a5ff4-700d-4b7d-9e92-d8e4f819c687/istio-proxy/0.log"
Jul 10 23:41:01.710916 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.710887    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7947c57c45-77dnm_831a6973-f36c-424f-be85-d3bfa988869e/kube-auth-proxy/0.log"
Jul 10 23:41:01.782343 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.782234    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/0.log"
Jul 10 23:41:01.813087 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.813053    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/1.log"
Jul 10 23:41:01.841265 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.841239    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-49f96_e53fb6ae-e83d-4150-b471-732410b13d71/payload-pre-processing/0.log"
Jul 10 23:41:01.871996 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:01.871959    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rtjsk_933ee89a-c40f-46ad-ba82-318295f6a2ae/payload-processing/0.log"
Jul 10 23:41:02.638132 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:02.638098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ggqz6_a6ecc746-4c7c-4ef6-8630-fc7686b7f827/serve-healthcheck-canary/0.log"
Jul 10 23:41:03.256678 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:03.256649    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql24w_f97cfa18-fc9b-4db4-88b4-1942a43908b9/kube-rbac-proxy/0.log"
Jul 10 23:41:03.276331 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:03.276305    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql24w_f97cfa18-fc9b-4db4-88b4-1942a43908b9/exporter/0.log"
Jul 10 23:41:03.297879 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:03.297854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ql24w_f97cfa18-fc9b-4db4-88b4-1942a43908b9/extractor/0.log"
Jul 10 23:41:05.130989 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.130954    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pjdll/perf-node-gather-daemonset-zjrtc"
Jul 10 23:41:05.357776 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.357743    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-vtr5t_a7d53e3a-bfd2-4033-9c95-64caa9ddb165/manager/0.log"
Jul 10 23:41:05.493895 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.493857    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gvpxv_074262a2-d77a-4e42-90f3-9082b3cf94c0/manager/0.log"
Jul 10 23:41:05.583539 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.583489    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86cc69d557-vxrbm_25c36620-b174-4854-b486-8f39a8a6d772/manager/0.log"
Jul 10 23:41:05.602831 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.602804    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ltssw_21f4a97f-0520-42f2-9222-11870c30ef78/server/0.log"
Jul 10 23:41:05.668480 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.668449    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g8ctf_88df527e-e2a7-4f82-a846-f75ac7c9ed21/manager/0.log"
Jul 10 23:41:05.690161 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.690131    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-gqhvw_32772ee7-e155-4495-9cbd-9a746cfa88be/manager/0.log"
Jul 10 23:41:05.713801 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:05.713774    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58bf55498c-gqhvw_32772ee7-e155-4495-9cbd-9a746cfa88be/copy-manifests/0.log"
Jul 10 23:41:08.704954 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:08.704924    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nkzkw_ba5a5ff4-700d-4b7d-9e92-d8e4f819c687/istio-proxy/0.log"
Jul 10 23:41:08.908140 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:08.908115    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7947c57c45-77dnm_831a6973-f36c-424f-be85-d3bfa988869e/kube-auth-proxy/0.log"
Jul 10 23:41:08.938338 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:08.938313    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/0.log"
Jul 10 23:41:08.966973 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:08.966881    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/1.log"
Jul 10 23:41:08.985510 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:08.985469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-49f96_e53fb6ae-e83d-4150-b471-732410b13d71/payload-pre-processing/0.log"
Jul 10 23:41:09.003821 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:09.003794    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rtjsk_933ee89a-c40f-46ad-ba82-318295f6a2ae/payload-processing/0.log"
Jul 10 23:41:10.332739 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.332703    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nkzkw_ba5a5ff4-700d-4b7d-9e92-d8e4f819c687/istio-proxy/0.log"
Jul 10 23:41:10.542130 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.542052    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7947c57c45-77dnm_831a6973-f36c-424f-be85-d3bfa988869e/kube-auth-proxy/0.log"
Jul 10 23:41:10.578067 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.578045    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/0.log"
Jul 10 23:41:10.606546 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.606522    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-qmv9t_be2e3484-529b-4dac-85df-c7d15629f3df/istio-proxy/1.log"
Jul 10 23:41:10.631109 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.631077    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-49f96_e53fb6ae-e83d-4150-b471-732410b13d71/payload-pre-processing/0.log"
Jul 10 23:41:10.651937 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:10.651899    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-rtjsk_933ee89a-c40f-46ad-ba82-318295f6a2ae/payload-processing/0.log"
Jul 10 23:41:13.902686 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:13.902652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7ph8n_a9a83ce2-f306-4d77-aff3-acfadaf0c415/kube-multus/0.log"
Jul 10 23:41:14.064721 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.064689    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/kube-multus-additional-cni-plugins/0.log"
Jul 10 23:41:14.084188 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.084152    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/egress-router-binary-copy/0.log"
Jul 10 23:41:14.103856 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.103831    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/cni-plugins/0.log"
Jul 10 23:41:14.122656 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.122635    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/bond-cni-plugin/0.log"
Jul 10 23:41:14.141223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.141202    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/routeoverride-cni/0.log"
Jul 10 23:41:14.159532 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.159456    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/whereabouts-cni-bincopy/0.log"
Jul 10 23:41:14.178223 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.178199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tzp4h_030f880a-07b9-4a75-abbc-90c3bebfce2b/whereabouts-cni/0.log"
Jul 10 23:41:14.406404 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.406371    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b5l7_61d5394c-8189-4be6-9371-5dbbd68b31ce/network-metrics-daemon/0.log"
Jul 10 23:41:14.424045 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:14.423959    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b5l7_61d5394c-8189-4be6-9371-5dbbd68b31ce/kube-rbac-proxy/0.log"
Jul 10 23:41:15.601370 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.601342    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-controller/0.log"
Jul 10 23:41:15.618241 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.618211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/1.log"
Jul 10 23:41:15.618401 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.618268    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovn-acl-logging/0.log"
Jul 10 23:41:15.636377 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.636354    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/kube-rbac-proxy-node/0.log"
Jul 10 23:41:15.655850 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.655828    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 23:41:15.670482 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.670462    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/northd/0.log"
Jul 10 23:41:15.691458 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.691438    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/nbdb/0.log"
Jul 10 23:41:15.709968 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.709950    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/sbdb/0.log"
Jul 10 23:41:15.761573 ip-10-0-139-179 kubenswrapper[2558]: I0710 23:41:15.761547    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhh8g_5acc81dc-0565-4b5e-ab49-a69f44edc9f8/ovnkube-controller/0.log"