Jul 26 15:48:09.066948 ip-10-0-128-173 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 26 15:48:09.066959 ip-10-0-128-173 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 26 15:48:09.066966 ip-10-0-128-173 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 26 15:48:09.067172 ip-10-0-128-173 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 26 15:48:19.033689 ip-10-0-128-173 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 26 15:48:19.033761 ip-10-0-128-173 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0e08908af7e04de781f430b64b1d8421 --
Jul 26 15:50:02.348136 ip-10-0-128-173 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 15:50:02.754046 ip-10-0-128-173 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:02.754046 ip-10-0-128-173 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 15:50:02.754046 ip-10-0-128-173 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:02.754046 ip-10-0-128-173 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 15:50:02.754046 ip-10-0-128-173 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 15:50:02.755044 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.754962    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 15:50:02.758477 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758463    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.758477 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758477    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758481    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758484    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758487    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758489    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758492    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758495    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758497    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758506    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758511    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758514    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758517    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758520    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758523    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758526    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758528    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758531    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758534    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758536    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.758537 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758539    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758542    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758544    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758547    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758550    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758553    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758556    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758558    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758561    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758563    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758565    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758568    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758570    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758574    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758576    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758579    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758581    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758583    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758586    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758588    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.759216 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758591    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.759800 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758593    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.759800 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.758632    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.759969 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759956    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.759969 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759967    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.759969 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759970    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759974    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759977    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759980    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759983    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759986    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759989    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759992    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759995    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.759998    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760001    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760010    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760015    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760019    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760022    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760026    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760028    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760031    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760034    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.760110 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760037    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760039    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760042    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760045    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760050    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760053    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760056    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760059    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760061    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760064    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760067    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760119    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760145    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760152    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760158    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760163    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760173    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760181    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760187    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760192    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.760843 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760197    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760202    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760206    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760260    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760266    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760271    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760276    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760281    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760286    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760290    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760295    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760299    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760304    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760309    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.761652 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.760313    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761727    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761738    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761743    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761747    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761751    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761756    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761760    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761764    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761768    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761773    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761777    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761781    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761787    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761791    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761795    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761799    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761803    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761807    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761811    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.762236 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761815    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761819    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761823    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761827    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761831    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761835    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761839    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761847    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761868    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761874    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761879    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761883    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761887    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761892    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761896    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761901    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761906    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761911    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.763111 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761915    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761919    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761923    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761927    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761932    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761936    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761940    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761944    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761948    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761952    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761956    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761960    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761964    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761968    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761972    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761976    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761980    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761984    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761988    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761992    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.763956 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.761997    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762001    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762007    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762011    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762015    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762019    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762023    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762027    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762032    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762036    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762040    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762044    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762048    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762052    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762057    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762062    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762066    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762070    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762074    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.764813 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762081    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762087    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762092    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762097    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762101    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762106    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762111    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762115    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762120    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762127    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762132    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762136    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762141    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762145    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762150    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762155    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762159    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762163    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762167    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.765365 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762171    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762176    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762180    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762783    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762791    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762796    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762800    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762805    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762809    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762813    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762817    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762821    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762832    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762837    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762841    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762845    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762882    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762887    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762891    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762896    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.766000 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762899    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762904    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762908    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762913    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762918    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762922    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762929    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762934    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762939    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762943    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762947    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762952    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762956    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762961    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762965    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762969    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762973    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762978    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762982    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.766580 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762986    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762991    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.762996    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763001    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763005    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763009    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763013    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763017    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763021    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763026    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763030    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763034    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763038    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763042    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763047    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763051    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763055    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763059    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763063    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763068    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.767149 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763072    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763077    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763082    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763086    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763090    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763094    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763098    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763103    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763107    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763111    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763115    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763119    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763123    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763127    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763131    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763136    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763140    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763144    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763148    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.767690 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763156    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763160    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763165    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763169    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763173    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763178    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763182    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763186    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763191    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763195    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763199    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763203    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763208    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763212    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763216    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763220    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763225    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763233    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763238    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.768242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763243    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763248    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763255    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763260    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.763265    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763363    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763374    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763385    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763392    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763399    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763404    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763410    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763417    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763422    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763427    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763433    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763439    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763443    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763448    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763453    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763458    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763462    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763467    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 15:50:02.768694 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763474    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763479    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763484    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763489    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763494    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763500    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763504    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763511    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763516    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763522    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763527    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763531    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763537    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763541    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763548    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763553    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763559    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763563    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763568    2576 flags.go:64] FLAG: --enable-server="true"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763572    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763580    2576 flags.go:64] FLAG: --event-burst="100"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763585    2576 flags.go:64] FLAG: --event-qps="50"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763589    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763594    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 15:50:02.769346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763599    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763605    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763610    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763614    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763619    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763623    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763628    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763633    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763637    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763642    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763647    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763652    2576 flags.go:64] FLAG: --feature-gates=""
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763658    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763662    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763667    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763672    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763678    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763684    2576 flags.go:64] FLAG: --help="false"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763688    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-173.ec2.internal"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763693    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763698    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763703    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763708    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 15:50:02.769910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763713    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763718    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763722    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763727    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763732    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763737    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763742    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763747    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763751    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763756    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763761    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763765    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763770    2576 flags.go:64] FLAG: --lock-file=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763774    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763779    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763784    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763793    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763798    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763802    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763806    2576 flags.go:64] FLAG: --logging-format="text"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763811    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763817    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763821    2576 flags.go:64] FLAG: --manifest-url=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763826    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763833    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 15:50:02.770536 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763837    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763845    2576 flags.go:64] FLAG: --max-pods="110"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763868    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763874    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763879    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763883    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763888    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763893    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763898    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763908    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763913    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763918    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763922    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763927    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763936    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763940    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763945    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763950    2576 flags.go:64] FLAG: --port="10250"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763954    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763959    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07256f1ced1ee2882"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763963    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763968    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763973    2576 flags.go:64] FLAG: --register-node="true"
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763977    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 26 15:50:02.771184 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763983    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763988    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763993    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.763998    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764004    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764009    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764014    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764019    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764024    2576 flags.go:64] FLAG: --runonce="false"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764028    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764035    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764040    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764045    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764050    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764055    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764059    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764064    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764069    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764074    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764091    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764096    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764100    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764105    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764109    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764118    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 15:50:02.771753 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764123    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764127    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764134    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764138    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764143    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764147    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764152    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764158    2576 flags.go:64] FLAG: --v="2"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764164    2576 flags.go:64] FLAG: --version="false"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764171    2576 flags.go:64] FLAG: --vmodule=""
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764176    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764182    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764347    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764354    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764360    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764365    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764370    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764379    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764384    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764388    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764393    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764397    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764401    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.772480 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764405    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764409    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764414    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764418    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764422    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764426    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764430    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764435    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764439    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764443    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764448    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764452    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764456    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764460    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764464    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764469    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764473    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764477    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764482    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764486    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.773044 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764490    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764494    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764499    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764503    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764507    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764511    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764516    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764520    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764525    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764530    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764534    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764539    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764543    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764547    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764551    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764555    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764559    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764563    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764567    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764571    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.773512 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764576    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764580    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764584    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764590    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764595    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764599    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764603    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764609    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764616    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764622    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764627    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764632    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764636    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764640    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764645    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764649    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764654    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764658    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764665    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.774012 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764669    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764673    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764678    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764682    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764686    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764690    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764694    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764698    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764703    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764707    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764711    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764715    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764719    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764723    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764727    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764731    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764735    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764739    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764743    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.774469 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764748    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764756    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764761    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764765    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764770    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764774    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764778    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764782    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764787    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.764791    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.764799    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.771614    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.771628    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.772469    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 15:50:02.774965 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.772476    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772529    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772534    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772537    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772540    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772543    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772546    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772548    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772551    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772553    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772556    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772559    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772561    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772564    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772567    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772569    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772572    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772574    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772577    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772579    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.775314 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772582    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772584    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772587    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772590    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772592    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772595    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772597    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772600    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772602    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772605    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772608    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772611    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772613    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772616    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772619    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772622    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772624    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772627    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772629    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772632    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.775778 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772634    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772637    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772640    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772642    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772645    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772647    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772650    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772652    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772655    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772657    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772659    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772662    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772665    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772668    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772671    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772675    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772678    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772682    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.776292 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772685    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772688    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772692    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772696    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772699    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772702    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772705    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772708    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772710    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772713    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772716    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772718    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772721    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772723    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772726    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772728    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772731    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772733    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772735    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.776717 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772738    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772740    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772742    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772745    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772747    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772750    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772752    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772755    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772757    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772760    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772762    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772765    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772768    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772770    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772773    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772775    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772777    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772780    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772782    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772785    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.777181 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772787    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772790    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772792    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.772804    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772946    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772950    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772953    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772956    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772959    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772961    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772964    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772966    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772969    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772971    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772974    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 15:50:02.777647 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772976    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772979    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772981    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772983    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772986    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772988    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772990    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772993    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772996    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.772998    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773001    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773003    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773006    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773008    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773012    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773014    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773017    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773019    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773021    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 15:50:02.778016 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773024    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773026    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773036    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773040    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773043    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773046    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773049    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773052    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773054    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773057    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773060    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773062    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773064    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773067    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773069    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773072    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773074    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773076    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773079    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773081    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 15:50:02.778451 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773084    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773086    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773089    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773091    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773093    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773096    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773098    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773100    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773103    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773107    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773110    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773113    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773115    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773118    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773120    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773128    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773131    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773133    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773136    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 15:50:02.778950 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773139    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773142    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773144    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773147    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773150    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773152    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773154    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773157    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773160    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773162    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773165    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773167    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773169    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773172    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773175    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773177    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773180    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773182    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773185    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773187    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 15:50:02.779410 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773189    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773192    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773194    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773196    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773199    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773201    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773204    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773206    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773208    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:02.773216    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.773220    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.773325    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.775365    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.776847    2576 server.go:1019] "Starting client certificate rotation"
Jul 26 15:50:02.779962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.776967    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:50:02.780309 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.776994    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 15:50:02.780309 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.779319    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:50:02.780973 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.780959    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 15:50:02.792380 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.792363    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 26 15:50:02.794212 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.794198    2576 log.go:25] "Validated CRI v1 image API"
Jul 26 15:50:02.795605 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.795588    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 15:50:02.797687 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.797666    2576 fs.go:135] Filesystem UUIDs: map[448ec7b6-dcf0-4ec9-8cff-6d2170e5c658:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e7e4f189-042f-496b-8e0c-3663032dbd08:/dev/nvme0n1p4]
Jul 26 15:50:02.797771 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.797686    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 15:50:02.802526 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.802412    2576 manager.go:216] Machine: {Timestamp:2026-07-26 15:50:02.801093387 +0000 UTC m=+0.339052960 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201671 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eecc96ffbd85a750d0792782669b9 SystemUUID:ec2eecc9-6ffb-d85a-750d-0792782669b9 BootID:0e08908a-f7e0-4de7-81f4-30b64b1d8421 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8c:ef:62:27:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8c:ef:62:27:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:56:1b:69:5a:98 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 15:50:02.802526 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.802518    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 15:50:02.802705 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.802614    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 15:50:02.805992 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.805963    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 15:50:02.806146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.805995    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 15:50:02.806708 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.806695    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 15:50:02.806738 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.806711    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 15:50:02.806738 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.806724    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:50:02.807418 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.807408    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 15:50:02.808099 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.808089    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 15:50:02.811126 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.811114    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:50:02.811252 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.811242    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 15:50:02.812001 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.811991    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 15:50:02.812033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812009    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 15:50:02.812033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812019    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 15:50:02.812033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812028    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 26 15:50:02.812137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812036    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 15:50:02.812375 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812365    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:50:02.812414 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.812384    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 15:50:02.814590 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.814573    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 15:50:02.816558 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.816541    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:50:02.817178 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.817166    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 15:50:02.817215 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.817194    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 15:50:02.818643 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818632    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818648    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818654    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818659    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818668    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818674    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 15:50:02.818686 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818684    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 15:50:02.818838 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818692    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 15:50:02.818838 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818703    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 15:50:02.818838 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818710    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 15:50:02.818838 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818717    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 15:50:02.818838 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.818724    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 15:50:02.819989 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.819978    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 15:50:02.820022 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.819990    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 15:50:02.823136 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.823122    2576 server.go:1268] "Started kubelet"
Jul 26 15:50:02.823233 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.823203    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 15:50:02.823286 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.823206    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 15:50:02.823331 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.823308    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 15:50:02.823836 ip-10-0-128-173 systemd[1]: Started Kubernetes Kubelet.
Jul 26 15:50:02.826039 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.826012    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 15:50:02.826325 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.826237    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 15:50:02.826464 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.826445    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 26 15:50:02.827616 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.827598    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 15:50:02.827765 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.827746    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 15:50:02.829090 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.829070    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 15:50:02.833865 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.832809    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-173.ec2.internal.18c5e1b6dc9190a6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-173.ec2.internal,UID:ip-10-0-128-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-173.ec2.internal,},FirstTimestamp:2026-07-26 15:50:02.823094438 +0000 UTC m=+0.361054012,LastTimestamp:2026-07-26 15:50:02.823094438 +0000 UTC m=+0.361054012,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-173.ec2.internal,}"
Jul 26 15:50:02.834274 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.834260    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 15:50:02.834323 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.834265    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 15:50:02.834482 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.834460    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:02.834836 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.834814    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 15:50:02.834836 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.834815    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 15:50:02.834995 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.834891    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 15:50:02.835046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835024    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 15:50:02.835046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835033    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 15:50:02.835046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835041    2576 factory.go:55] Registering systemd factory
Jul 26 15:50:02.835179 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835054    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 26 15:50:02.835259 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835239    2576 factory.go:153] Registering CRI-O factory
Jul 26 15:50:02.835259 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835256    2576 factory.go:223] Registration of the crio container factory successfully
Jul 26 15:50:02.835346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835298    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 15:50:02.835346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835316    2576 factory.go:103] Registering Raw factory
Jul 26 15:50:02.835346 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835330    2576 manager.go:1196] Started watching for new ooms in manager
Jul 26 15:50:02.835758 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.835744    2576 manager.go:349] Starting recovery of all containers
Jul 26 15:50:02.838629 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.838606    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 26 15:50:02.838711 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.838665    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 26 15:50:02.842960 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.842915    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 15:50:02.846274 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.846256    2576 manager.go:354] Recovery completed
Jul 26 15:50:02.847846 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.847820    2576 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 26 15:50:02.850803 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.850792    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:02.852505 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.852477    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:02.852563 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.852521    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:02.852563 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.852535    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:02.853046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.853034    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 15:50:02.853046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.853039    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:02.853046 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.853044    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 15:50:02.853196 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.853058    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 15:50:02.854156 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.854138    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:02.854219 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.854167    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:02.854219 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.854182    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:02.854329 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.854261    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-173.ec2.internal.18c5e1b6de525298  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-173.ec2.internal,UID:ip-10-0-128-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-173.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-173.ec2.internal,},FirstTimestamp:2026-07-26 15:50:02.852504216 +0000 UTC m=+0.390463793,LastTimestamp:2026-07-26 15:50:02.852504216 +0000 UTC m=+0.390463793,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-173.ec2.internal,}"
Jul 26 15:50:02.855581 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.855569    2576 policy_none.go:49] "None policy: Start"
Jul 26 15:50:02.855626 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.855586    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 15:50:02.855626 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.855596    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 15:50:02.857414 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.857404    2576 policy_none.go:47] "Start"
Jul 26 15:50:02.862571 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.862546    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcdjj"
Jul 26 15:50:02.864208 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.864149    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-173.ec2.internal.18c5e1b6de52b1bd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-173.ec2.internal,UID:ip-10-0-128-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-173.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-173.ec2.internal,},FirstTimestamp:2026-07-26 15:50:02.852528573 +0000 UTC m=+0.390488149,LastTimestamp:2026-07-26 15:50:02.852528573 +0000 UTC m=+0.390488149,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-173.ec2.internal,}"
Jul 26 15:50:02.867004 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.866942    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-173.ec2.internal.18c5e1b6de52dd5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-173.ec2.internal,UID:ip-10-0-128-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-173.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-173.ec2.internal,},FirstTimestamp:2026-07-26 15:50:02.852539743 +0000 UTC m=+0.390499316,LastTimestamp:2026-07-26 15:50:02.852539743 +0000 UTC m=+0.390499316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-173.ec2.internal,}"
Jul 26 15:50:02.869676 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.869661    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcdjj"
Jul 26 15:50:02.874941 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.874820    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-173.ec2.internal.18c5e1b6de525298\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-173.ec2.internal.18c5e1b6de525298  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-173.ec2.internal,UID:ip-10-0-128-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-173.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-173.ec2.internal,},FirstTimestamp:2026-07-26 15:50:02.852504216 +0000 UTC m=+0.390463793,LastTimestamp:2026-07-26 15:50:02.854154694 +0000 UTC m=+0.392114270,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-173.ec2.internal,}"
Jul 26 15:50:02.892552 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.892396    2576 manager.go:337] "Starting Device Plugin manager"
Jul 26 15:50:02.892651 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.892592    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 15:50:02.892651 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.892606    2576 server.go:87] "Starting device plugin registration server"
Jul 26 15:50:02.892836 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.892822    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 15:50:02.892897 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.892837    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 15:50:02.892946 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.892929    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 15:50:02.893029 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.893014    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 15:50:02.893029 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.893026    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 15:50:02.893531 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.893512    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 15:50:02.893610 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.893557    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:02.953782 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.953754    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 15:50:02.955826 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.953792    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 15:50:02.955826 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.953814    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 15:50:02.955826 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:02.953866    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 15:50:02.956882 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.956868    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:02.992924 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.992910    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:02.993711 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.993697    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:02.993774 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.993727    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:02.993774 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.993741    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:02.993774 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:02.993761    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-173.ec2.internal"
Jul 26 15:50:03.002610 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.002597    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-173.ec2.internal"
Jul 26 15:50:03.002666 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:03.002615    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-173.ec2.internal\": node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:03.054958 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.054885    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"]
Jul 26 15:50:03.054958 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.054941    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:03.056516 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.056499    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:03.056600 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.056531    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:03.056600 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.056542    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:03.057093 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:03.057065    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:03.058773 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.058759    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:03.058935 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.058910    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:03.058984 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.058940    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:03.059488 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059470    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:03.059568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059474    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:03.059568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059504    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:03.059568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059517    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:03.059568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059553    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:03.059568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.059520    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:03.061876 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.061847    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:03.061933 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.061886    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:03.062507 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.062494    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:03.062595 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.062513    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:03.062595 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:03.062524    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:03.084444 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:03.084421    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-173.ec2.internal\" not found" node="ip-10-0-128-173.ec2.internal"
Jul 26 15:50:03.088271 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:03.088257    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-173.ec2.internal\" not found" node="ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.736309 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.736290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a21ba21338b6ba758e27d2cca1c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-128-173.ec2.internal\" (UID: \"70a21ba21338b6ba758e27d2cca1c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.736372 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.736313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.736372 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.736328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.757664 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:04.757632    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:04.836999 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.836975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a21ba21338b6ba758e27d2cca1c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-128-173.ec2.internal\" (UID: \"70a21ba21338b6ba758e27d2cca1c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.837084 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.837053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.837084 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.837064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.837152 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.837085    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70a21ba21338b6ba758e27d2cca1c0ab-config\") pod \"kube-apiserver-proxy-ip-10-0-128-173.ec2.internal\" (UID: \"70a21ba21338b6ba758e27d2cca1c0ab\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.837152 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.837097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.837152 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.837131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6dd50be5d2585bd24e7a6b31885c789e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal\" (UID: \"6dd50be5d2585bd24e7a6b31885c789e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.858109 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:04.858081    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:04.958875 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:04.958813    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:04.986955 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.986930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:04.992121 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:04.991709    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:05.059935 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.059894    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.160350 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.160324    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.260942 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.260873    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.355994 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.355967    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:05.361493 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.361474    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.375655 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.375624    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 15:50:05.375780 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.375752    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:50:05.375780 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.375764    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 15:50:05.462512 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.462488    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.476671 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.476625    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 15:45:04 +0000 UTC" deadline="2028-04-14 17:47:19.420822262 +0000 UTC"
Jul 26 15:50:05.476777 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.476672    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15073h57m13.944155942s"
Jul 26 15:50:05.562616 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.562593    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.570510 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:05.570482    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a21ba21338b6ba758e27d2cca1c0ab.slice/crio-9f1c80be9e5ee52a2197fcd415c99a9f7d23a9e5c14e0da74002c234195ed161 WatchSource:0}: Error finding container 9f1c80be9e5ee52a2197fcd415c99a9f7d23a9e5c14e0da74002c234195ed161: Status 404 returned error can't find the container with id 9f1c80be9e5ee52a2197fcd415c99a9f7d23a9e5c14e0da74002c234195ed161
Jul 26 15:50:05.572251 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:05.572224    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd50be5d2585bd24e7a6b31885c789e.slice/crio-ecb7570584f1f265dddab63ab7f4e0071ac4dfcab36f7d54c075ffc3b95cb378 WatchSource:0}: Error finding container ecb7570584f1f265dddab63ab7f4e0071ac4dfcab36f7d54c075ffc3b95cb378: Status 404 returned error can't find the container with id ecb7570584f1f265dddab63ab7f4e0071ac4dfcab36f7d54c075ffc3b95cb378
Jul 26 15:50:05.577093 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.577041    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:50:05.615886 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.615871    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 15:50:05.616889 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.616874    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 15:50:05.616961 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.616900    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 15:50:05.616961 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.616911    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeHasSufficientPID"
Jul 26 15:50:05.663052 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.663032    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.763516 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.763489    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.864003 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:05.863948    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-173.ec2.internal\" not found"
Jul 26 15:50:05.878759 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.878741    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:05.934562 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.934539    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:05.945276 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.945259    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:50:05.946047 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.946035    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal"
Jul 26 15:50:05.953831 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:05.953820    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 15:50:06.037349 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.037323    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:06.415621 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.413961    2576 apiserver.go:52] "Watching apiserver"
Jul 26 15:50:06.421462 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.421436    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 15:50:06.422446 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.422419    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z","openshift-cluster-node-tuning-operator/tuned-7cxsm","openshift-dns/node-resolver-gjx8b","openshift-image-registry/node-ca-q7kfm","openshift-multus/multus-wtsdg","openshift-multus/network-metrics-daemon-5twbk","openshift-network-diagnostics/network-check-target-xzrx8","openshift-network-operator/iptables-alerter-b75wl","kube-system/global-pull-secret-syncer-4qfqv","kube-system/konnectivity-agent-zhzjc","kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal","openshift-multus/multus-additional-cni-plugins-hhvgc","openshift-ovn-kubernetes/ovnkube-node-b8686"]
Jul 26 15:50:06.424994 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.424970    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:06.425102 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.425049    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:06.427217 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.427193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.429274 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.429251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.429989 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.429968    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 15:50:06.430178 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.430162    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.430243 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.430178    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 15:50:06.430243 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.430197    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.430348 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.430161    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 15:50:06.430348 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.430254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kvcwl\""
Jul 26 15:50:06.431128 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.431108    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.431369 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.431349    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qcfn\""
Jul 26 15:50:06.431520 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.431504    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.431697 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.431665    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.433360 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.433342    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9rbg\""
Jul 26 15:50:06.433447 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.433410    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 15:50:06.433629 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.433613    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.433709 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.433633    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.433909 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.433888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.435232 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.435213    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 15:50:06.435734 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.435716    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 15:50:06.435820 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.435789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-225vd\""
Jul 26 15:50:06.435995 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.435979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.436073 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.436053    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:06.440215 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.439402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.442433 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.441771    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 15:50:06.442433 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.441919    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.442433 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.441938    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 15:50:06.442433 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.442127    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.443792 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.443742    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s75px\""
Jul 26 15:50:06.443917 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.443871    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.443995 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.443980    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 15:50:06.444180 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.444163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 15:50:06.444290 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.444272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.444806 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.444786    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 15:50:06.444887 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.444821    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.444887 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.444882    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qpw4p\""
Jul 26 15:50:06.445077 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.445047    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.446467 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.446445    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 15:50:06.446990 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.446768    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.446990 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.446805    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.446990 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.446848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dj7bg\""
Jul 26 15:50:06.447176 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.446995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.447566 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-etc-kubernetes\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.447643 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzcgw\" (UniqueName: \"kubernetes.io/projected/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-kube-api-access-kzcgw\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.447643 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:06.447643 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-system-cni-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.447823 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-cnibin\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.447823 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-multus\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.447823 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-daemon-config\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.447823 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6l58\" (UniqueName: \"kubernetes.io/projected/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-kube-api-access-l6l58\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.447823 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f21ef924-2561-4319-9f87-2ddd8c29e3c7-serviceca\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmm86\" (UniqueName: \"kubernetes.io/projected/f21ef924-2561-4319-9f87-2ddd8c29e3c7-kube-api-access-wmm86\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447877    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-socket-dir-parent\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.447962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scs9g\" (UniqueName: \"kubernetes.io/projected/9db49ed9-01db-4772-b03c-6a1d40b6b046-kube-api-access-scs9g\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-hosts-file\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-os-release\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-conf-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-os-release\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-kubelet\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-k8s-cni-cncf-io\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2chjh\" (UniqueName: \"kubernetes.io/projected/81710507-45b0-4bfc-8b08-5da1dde7748d-kube-api-access-2chjh\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-cni-binary-copy\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-netns\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-bin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f21ef924-2561-4319-9f87-2ddd8c29e3c7-host\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.448389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-cnibin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-tmp-dir\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-system-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-hostroot\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.448957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-multus-certs\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.449528 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.449528 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448982    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 15:50:06.449528 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.448989    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:50:06.449528 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.449110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9j6f4\""
Jul 26 15:50:06.449820 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.449803    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 15:50:06.450958 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.450935    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 15:50:06.451578 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.451071    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 15:50:06.451578 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.451182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-npbfs\""
Jul 26 15:50:06.451578 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.451338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.451578 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.451400    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:06.467120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.467100    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rv6st"
Jul 26 15:50:06.474857 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.474841    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rv6st"
Jul 26 15:50:06.536520 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.536497    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 15:50:06.548820 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-tmp-dir\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.548939 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-system-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.548939 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-etc-kubernetes\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.548939 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-slash\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.548939 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-etc-kubernetes\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-system-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.548982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-conf\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-system-cni-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-cnibin\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-system-cni-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-multus\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-multus\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549120 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549104    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-cnibin\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fpsc\" (UniqueName: \"kubernetes.io/projected/567ad180-788f-4366-bafc-cd0cb966a0da-kube-api-access-5fpsc\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549149    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-tmp-dir\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-var-lib-kubelet\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549184    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgx7n\" (UniqueName: \"kubernetes.io/projected/881c71f7-fdde-492d-8603-6a37d31143ed-kube-api-access-jgx7n\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f21ef924-2561-4319-9f87-2ddd8c29e3c7-serviceca\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmm86\" (UniqueName: \"kubernetes.io/projected/f21ef924-2561-4319-9f87-2ddd8c29e3c7-kube-api-access-wmm86\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-modprobe-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-run\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-socket-dir-parent\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scs9g\" (UniqueName: \"kubernetes.io/projected/9db49ed9-01db-4772-b03c-6a1d40b6b046-kube-api-access-scs9g\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-hosts-file\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-os-release\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.549481 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-bin\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549496    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-socket-dir-parent\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-tmp\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-hosts-file\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-os-release\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgmf\" (UniqueName: \"kubernetes.io/projected/b2621d71-bfb8-46af-a87e-e14bdae22f7e-kube-api-access-ntgmf\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-os-release\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-kubelet\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f21ef924-2561-4319-9f87-2ddd8c29e3c7-serviceca\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-os-release\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-sys-fs\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-kubelet\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-kubernetes\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-etc-tuned\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-env-overrides\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-systemd\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.550177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2chjh\" (UniqueName: \"kubernetes.io/projected/81710507-45b0-4bfc-8b08-5da1dde7748d-kube-api-access-2chjh\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.549972    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-netns\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-etc-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysconfig\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-node-log\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550138    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f21ef924-2561-4319-9f87-2ddd8c29e3c7-host\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550181    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f21ef924-2561-4319-9f87-2ddd8c29e3c7-host\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-cnibin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-hostroot\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-cnibin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9db49ed9-01db-4772-b03c-6a1d40b6b046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-multus-certs\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-multus-certs\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-cni-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-hostroot\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.550880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-device-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-log-socket\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-daemon-config\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/689f9e49-860e-4a57-98d7-4cff20347277-agent-certs\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-lib-modules\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2621d71-bfb8-46af-a87e-e14bdae22f7e-iptables-alerter-script\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-dbus\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6l58\" (UniqueName: \"kubernetes.io/projected/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-kube-api-access-l6l58\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.550980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-systemd-units\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.551139    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:06.551589 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-daemon-config\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.551526    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:07.051476622 +0000 UTC m=+2.989600952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/567ad180-788f-4366-bafc-cd0cb966a0da-ovn-node-metrics-cert\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551702    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-conf-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551761    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-multus-conf-dir\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-registration-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2621d71-bfb8-46af-a87e-e14bdae22f7e-host-slash\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.551958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4dx\" (UniqueName: \"kubernetes.io/projected/6916878b-2fcb-4ada-a939-a4ea83c867a7-kube-api-access-xn4dx\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-kubelet\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-systemd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-k8s-cni-cncf-io\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-socket-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-var-lib-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.552328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-host\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-ovn\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-netd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9db49ed9-01db-4772-b03c-6a1d40b6b046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-config\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-script-lib\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-sys\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-k8s-cni-cncf-io\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-cni-binary-copy\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-netns\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-bin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552768    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-run-netns\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552817    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzcgw\" (UniqueName: \"kubernetes.io/projected/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-kube-api-access-kzcgw\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/689f9e49-860e-4a57-98d7-4cff20347277-konnectivity-ca\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.553035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.552919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-kubelet-config\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.553717 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.553478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81710507-45b0-4bfc-8b08-5da1dde7748d-cni-binary-copy\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.553717 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.553552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/81710507-45b0-4bfc-8b08-5da1dde7748d-host-var-lib-cni-bin\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.555984 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.555890    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:06.555984 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.555932    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:06.555984 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.555947    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:06.556181 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.556154    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:07.056135057 +0000 UTC m=+2.994259381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:06.556248 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.556169    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 15:50:06.560509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.560369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmm86\" (UniqueName: \"kubernetes.io/projected/f21ef924-2561-4319-9f87-2ddd8c29e3c7-kube-api-access-wmm86\") pod \"node-ca-q7kfm\" (UID: \"f21ef924-2561-4319-9f87-2ddd8c29e3c7\") " pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.560509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.560404    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scs9g\" (UniqueName: \"kubernetes.io/projected/9db49ed9-01db-4772-b03c-6a1d40b6b046-kube-api-access-scs9g\") pod \"multus-additional-cni-plugins-hhvgc\" (UID: \"9db49ed9-01db-4772-b03c-6a1d40b6b046\") " pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.560509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.560404    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2chjh\" (UniqueName: \"kubernetes.io/projected/81710507-45b0-4bfc-8b08-5da1dde7748d-kube-api-access-2chjh\") pod \"multus-wtsdg\" (UID: \"81710507-45b0-4bfc-8b08-5da1dde7748d\") " pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.560741 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.560526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal" event={"ID":"70a21ba21338b6ba758e27d2cca1c0ab","Type":"ContainerStarted","Data":"9f1c80be9e5ee52a2197fcd415c99a9f7d23a9e5c14e0da74002c234195ed161"}
Jul 26 15:50:06.560741 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.560622    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6l58\" (UniqueName: \"kubernetes.io/projected/5ff48070-2040-4d65-9ae1-3d2e695b3ebb-kube-api-access-l6l58\") pod \"node-resolver-gjx8b\" (UID: \"5ff48070-2040-4d65-9ae1-3d2e695b3ebb\") " pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.562004 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.561980    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal" event={"ID":"6dd50be5d2585bd24e7a6b31885c789e","Type":"ContainerStarted","Data":"ecb7570584f1f265dddab63ab7f4e0071ac4dfcab36f7d54c075ffc3b95cb378"}
Jul 26 15:50:06.562324 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.562304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzcgw\" (UniqueName: \"kubernetes.io/projected/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-kube-api-access-kzcgw\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:06.654038 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-env-overrides\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654038 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-systemd\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654064    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-netns\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-etc-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysconfig\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-node-log\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654145    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-netns\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-device-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-systemd\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysconfig\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-log-socket\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-node-log\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-log-socket\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-etc-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654297    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/689f9e49-860e-4a57-98d7-4cff20347277-agent-certs\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-etc-selinux\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-lib-modules\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-device-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-run-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2621d71-bfb8-46af-a87e-e14bdae22f7e-iptables-alerter-script\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-dbus\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-systemd-units\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/567ad180-788f-4366-bafc-cd0cb966a0da-ovn-node-metrics-cert\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654537    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-lib-modules\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654547    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-env-overrides\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-registration-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-systemd-units\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-dbus\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.654880 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2621d71-bfb8-46af-a87e-e14bdae22f7e-host-slash\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-registration-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2621d71-bfb8-46af-a87e-e14bdae22f7e-host-slash\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4dx\" (UniqueName: \"kubernetes.io/projected/6916878b-2fcb-4ada-a939-a4ea83c867a7-kube-api-access-xn4dx\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-kubelet\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-systemd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654842    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-kubelet\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-socket-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-var-lib-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-host\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.654912    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654882    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-systemd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-var-lib-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:06.654975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:07.154951307 +0000 UTC m=+3.093075629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-ovn\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.655674 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654996    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-host\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.654963    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-openvswitch\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-run-ovn\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-netd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-netd\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-config\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b2621d71-bfb8-46af-a87e-e14bdae22f7e-iptables-alerter-script\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-script-lib\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-sys\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/689f9e49-860e-4a57-98d7-4cff20347277-konnectivity-ca\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-kubelet-config\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-sys\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-slash\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-conf\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.656487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad2d4624-43e8-4832-a099-d8d88e62aa3b-kubelet-config\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fpsc\" (UniqueName: \"kubernetes.io/projected/567ad180-788f-4366-bafc-cd0cb966a0da-kube-api-access-5fpsc\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-slash\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-var-lib-kubelet\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgx7n\" (UniqueName: \"kubernetes.io/projected/881c71f7-fdde-492d-8603-6a37d31143ed-kube-api-access-jgx7n\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-modprobe-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-run\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655505    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-socket-dir\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-bin\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-tmp\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgmf\" (UniqueName: \"kubernetes.io/projected/b2621d71-bfb8-46af-a87e-e14bdae22f7e-kube-api-access-ntgmf\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655606    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-config\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-sys-fs\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-kubernetes\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-var-lib-kubelet\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-etc-tuned\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657281 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/567ad180-788f-4366-bafc-cd0cb966a0da-ovnkube-script-lib\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6916878b-2fcb-4ada-a939-a4ea83c867a7-sys-fs\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/689f9e49-860e-4a57-98d7-4cff20347277-konnectivity-ca\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-sysctl-conf\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-kubernetes\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-run\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.655944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/567ad180-788f-4366-bafc-cd0cb966a0da-host-cni-bin\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.656003    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/881c71f7-fdde-492d-8603-6a37d31143ed-etc-modprobe-d\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.657322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/567ad180-788f-4366-bafc-cd0cb966a0da-ovn-node-metrics-cert\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.657789    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/689f9e49-860e-4a57-98d7-4cff20347277-agent-certs\") pod \"konnectivity-agent-zhzjc\" (UID: \"689f9e49-860e-4a57-98d7-4cff20347277\") " pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.657918 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.657861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-tmp\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.658243 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.658068    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/881c71f7-fdde-492d-8603-6a37d31143ed-etc-tuned\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.663036 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.663009    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4dx\" (UniqueName: \"kubernetes.io/projected/6916878b-2fcb-4ada-a939-a4ea83c867a7-kube-api-access-xn4dx\") pod \"aws-ebs-csi-driver-node-j5z2z\" (UID: \"6916878b-2fcb-4ada-a939-a4ea83c867a7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.663680 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.663647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fpsc\" (UniqueName: \"kubernetes.io/projected/567ad180-788f-4366-bafc-cd0cb966a0da-kube-api-access-5fpsc\") pod \"ovnkube-node-b8686\" (UID: \"567ad180-788f-4366-bafc-cd0cb966a0da\") " pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.664069 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.664048    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgmf\" (UniqueName: \"kubernetes.io/projected/b2621d71-bfb8-46af-a87e-e14bdae22f7e-kube-api-access-ntgmf\") pod \"iptables-alerter-b75wl\" (UID: \"b2621d71-bfb8-46af-a87e-e14bdae22f7e\") " pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.664345 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.664327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgx7n\" (UniqueName: \"kubernetes.io/projected/881c71f7-fdde-492d-8603-6a37d31143ed-kube-api-access-jgx7n\") pod \"tuned-7cxsm\" (UID: \"881c71f7-fdde-492d-8603-6a37d31143ed\") " pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.744399 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.744333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhvgc"
Jul 26 15:50:06.752978 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.752960    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gjx8b"
Jul 26 15:50:06.762681 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.762656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q7kfm"
Jul 26 15:50:06.767234 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.767214    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wtsdg"
Jul 26 15:50:06.775832 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.775810    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:06.781796 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.781777    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z"
Jul 26 15:50:06.789417 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.789399    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cxsm"
Jul 26 15:50:06.797893 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.797876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b75wl"
Jul 26 15:50:06.803429 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.803411    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:06.861635 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:06.861610    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:07.058372 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.058288    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:07.058372 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.058334    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:07.058590 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058443    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:07.058590 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058482    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:07.058590 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058506    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:07.058590 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058520    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:07.058590 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058507    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.058489503 +0000 UTC m=+3.996613811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:07.058865 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.058598    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.058575513 +0000 UTC m=+3.996699839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:07.158900 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.158864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:07.159069 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.159040    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:07.159131 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:07.159109    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:08.159094144 +0000 UTC m=+4.097218453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:07.477812 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.477782    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:45:06 +0000 UTC" deadline="2028-03-03 15:53:45.01336634 +0000 UTC"
Jul 26 15:50:07.477812 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.477810    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14064h3m37.535559538s"
Jul 26 15:50:07.483884 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:07.483857    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21ef924_2561_4319_9f87_2ddd8c29e3c7.slice/crio-dc0fcf67b7208260ac976caf1f25c4a5435266afb251983093908664015b9fd6 WatchSource:0}: Error finding container dc0fcf67b7208260ac976caf1f25c4a5435266afb251983093908664015b9fd6: Status 404 returned error can't find the container with id dc0fcf67b7208260ac976caf1f25c4a5435266afb251983093908664015b9fd6
Jul 26 15:50:07.485350 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:07.485300    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689f9e49_860e_4a57_98d7_4cff20347277.slice/crio-ab8853696a75b29286b61b0723f8104f58805ea852969eb506a2cdcf3d68cb61 WatchSource:0}: Error finding container ab8853696a75b29286b61b0723f8104f58805ea852969eb506a2cdcf3d68cb61: Status 404 returned error can't find the container with id ab8853696a75b29286b61b0723f8104f58805ea852969eb506a2cdcf3d68cb61
Jul 26 15:50:07.492317 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:07.492292    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567ad180_788f_4366_bafc_cd0cb966a0da.slice/crio-02d22d5eda3774037ac8ba3cf7da439aa455dc522f2f313ff17809ff99386229 WatchSource:0}: Error finding container 02d22d5eda3774037ac8ba3cf7da439aa455dc522f2f313ff17809ff99386229: Status 404 returned error can't find the container with id 02d22d5eda3774037ac8ba3cf7da439aa455dc522f2f313ff17809ff99386229
Jul 26 15:50:07.493286 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:07.493247    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6916878b_2fcb_4ada_a939_a4ea83c867a7.slice/crio-0ccf0b3ac33fdd89be95853ed8721684cbdfe7065e87eec6ddcd04a7b1bbab7b WatchSource:0}: Error finding container 0ccf0b3ac33fdd89be95853ed8721684cbdfe7065e87eec6ddcd04a7b1bbab7b: Status 404 returned error can't find the container with id 0ccf0b3ac33fdd89be95853ed8721684cbdfe7065e87eec6ddcd04a7b1bbab7b
Jul 26 15:50:07.570942 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.570775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjx8b" event={"ID":"5ff48070-2040-4d65-9ae1-3d2e695b3ebb","Type":"ContainerStarted","Data":"98df4661dd6c113e8b34ddd494790d3bb9111bc85b935f05938196d6f515520c"}
Jul 26 15:50:07.571840 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.571820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerStarted","Data":"ba591dbca0adbc552657ddae8aacc73a483c68faf06643b08a4dd3a0d739341b"}
Jul 26 15:50:07.574663 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.574639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wtsdg" event={"ID":"81710507-45b0-4bfc-8b08-5da1dde7748d","Type":"ContainerStarted","Data":"be02af978efcc7cdcc8e316d3bce56ddc437b3477c4c5e184a36d1ae0a25e57a"}
Jul 26 15:50:07.577240 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.577221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z" event={"ID":"6916878b-2fcb-4ada-a939-a4ea83c867a7","Type":"ContainerStarted","Data":"0ccf0b3ac33fdd89be95853ed8721684cbdfe7065e87eec6ddcd04a7b1bbab7b"}
Jul 26 15:50:07.581053 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.581033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cxsm" event={"ID":"881c71f7-fdde-492d-8603-6a37d31143ed","Type":"ContainerStarted","Data":"d6074269180483c2b90436b329b18a261c08d9f176127236b65eca31f4b4d89f"}
Jul 26 15:50:07.582804 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.582776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"02d22d5eda3774037ac8ba3cf7da439aa455dc522f2f313ff17809ff99386229"}
Jul 26 15:50:07.585240 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.585209    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b75wl" event={"ID":"b2621d71-bfb8-46af-a87e-e14bdae22f7e","Type":"ContainerStarted","Data":"037dd1833b5012e622a2ec8d79521eada5bb7e6c4f3ee2642c7bb751d84a90c6"}
Jul 26 15:50:07.586124 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.586102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zhzjc" event={"ID":"689f9e49-860e-4a57-98d7-4cff20347277","Type":"ContainerStarted","Data":"ab8853696a75b29286b61b0723f8104f58805ea852969eb506a2cdcf3d68cb61"}
Jul 26 15:50:07.587344 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:07.587325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q7kfm" event={"ID":"f21ef924-2561-4319-9f87-2ddd8c29e3c7","Type":"ContainerStarted","Data":"dc0fcf67b7208260ac976caf1f25c4a5435266afb251983093908664015b9fd6"}
Jul 26 15:50:08.065178 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.065140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:08.065351 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.065194    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:08.065351 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065340    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:08.065474 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065399    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:10.065381104 +0000 UTC m=+6.003505413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:08.065843 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065826    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:08.065906 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065850    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:08.065906 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065863    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:08.066015 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.065906    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:10.06589218 +0000 UTC m=+6.004016491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:08.166201 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.166169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:08.166368 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.166311    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:08.166426 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.166377    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:10.166357507 +0000 UTC m=+6.104481830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:08.349723 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.349374    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 15:50:08.478191 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.478129    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 15:45:06 +0000 UTC" deadline="2028-03-23 08:37:29.090664404 +0000 UTC"
Jul 26 15:50:08.478191 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.478189    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14536h47m20.61247925s"
Jul 26 15:50:08.556421 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.556398    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:08.556552 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.556528    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:08.556960 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.556940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:08.557245 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.557039    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:08.557245 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.557104    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:08.557245 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:08.557179    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:08.595900 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.595867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal" event={"ID":"70a21ba21338b6ba758e27d2cca1c0ab","Type":"ContainerStarted","Data":"ef9755ad606c42f66ff935e212c2a0bfccd988e578088c610338ec35e5698e6e"}
Jul 26 15:50:08.605043 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.604902    2576 generic.go:356] "Generic (PLEG): container finished" podID="6dd50be5d2585bd24e7a6b31885c789e" containerID="38eda5995ea6449ba2bbdd1964759927110433399ea48af11a318a2e20ba5db0" exitCode=0
Jul 26 15:50:08.605043 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.604945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal" event={"ID":"6dd50be5d2585bd24e7a6b31885c789e","Type":"ContainerDied","Data":"38eda5995ea6449ba2bbdd1964759927110433399ea48af11a318a2e20ba5db0"}
Jul 26 15:50:08.611573 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:08.610749    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-173.ec2.internal" podStartSLOduration=3.6107315250000003 podStartE2EDuration="3.610731525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:08.610008333 +0000 UTC m=+4.548132664" watchObservedRunningTime="2026-07-26 15:50:08.610731525 +0000 UTC m=+4.548855857"
Jul 26 15:50:09.622273 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:09.622239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal" event={"ID":"6dd50be5d2585bd24e7a6b31885c789e","Type":"ContainerStarted","Data":"7a6cccdd6a58a14ffb9739ce7145c5661c8fd23d57feb0832af4dd05c84ada23"}
Jul 26 15:50:10.081226 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.081144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:10.081226 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.081204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:10.081540 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081368    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:10.081540 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081429    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:14.081412563 +0000 UTC m=+10.019536874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:10.081899 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081878    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:10.081991 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081906    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:10.081991 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081919    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:10.081991 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.081976    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:14.081959527 +0000 UTC m=+10.020083840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:10.182269 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.181805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:10.182269 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.181907    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:10.182269 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.181956    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:14.181942441 +0000 UTC m=+10.120066750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:10.555730 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.555392    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:10.555730 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.555528    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:10.555730 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.555547    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:10.555730 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.555676    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:10.555730 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:10.555396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:10.556183 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:10.555789    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:12.553983 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:12.553952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:12.554405 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:12.554086    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:12.554892 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:12.554561    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:12.554892 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:12.554681    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:12.554892 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:12.554746    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:12.554892 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:12.554842    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.115098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.115148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115284    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115301    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115320    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115332    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115342    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:22.115324711 +0000 UTC m=+18.053449036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:14.115705 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.115367    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:22.115356862 +0000 UTC m=+18.053481185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:14.216196 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.216159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:14.216375 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.216305    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:14.216375 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.216366    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:22.216349164 +0000 UTC m=+18.154473476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.557334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.557495    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.557931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.558024    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:14.558081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:14.558255 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:14.558145    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:16.554219 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:16.554186    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:16.554219 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:16.554202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:16.554664 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:16.554287    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:16.554664 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:16.554332    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:16.554664 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:16.554384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:16.554664 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:16.554530    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:18.554735 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:18.554670    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:18.554735 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:18.554725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:18.555232 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:18.554679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:18.555232 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:18.554833    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:18.555232 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:18.554914    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:18.555232 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:18.554994    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:20.554361 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:20.554326    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:20.554361 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:20.554361    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:20.554922 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:20.554330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:20.554922 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:20.554450    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:20.554922 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:20.554539    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:20.554922 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:20.554602    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:22.174832 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.174801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:22.174832 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.174839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.174934    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.174963    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.174988    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.174995    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.174976136 +0000 UTC m=+34.113100445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.175002    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:22.175364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.175048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.175035999 +0000 UTC m=+34.113160309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:22.275992 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.275952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:22.276168 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.276098    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:22.276168 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.276165    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:38.276150401 +0000 UTC m=+34.214274709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:22.554093 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.554019    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:22.554093 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.554044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:22.554299 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.554136    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:22.554299 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.554222    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:22.554299 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:22.554282    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:22.554428 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:22.554349    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:24.554909 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:24.554878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:24.555311 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:24.554964    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:24.555311 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:24.555046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:24.555311 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:24.555125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:24.555311 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:24.555168    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:24.555311 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:24.555235    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:26.554412 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.554090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:26.555278 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.554103    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:26.555278 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.554157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:26.555278 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:26.554509    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:26.555278 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:26.554630    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:26.555278 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:26.554760    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:26.655210 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.655174    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gjx8b" event={"ID":"5ff48070-2040-4d65-9ae1-3d2e695b3ebb","Type":"ContainerStarted","Data":"c27144618e2f31835792d085a36a66db99aa710b6600b8fbbaf178c54b11d6d6"}
Jul 26 15:50:26.656873 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.656852    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="2a5dc9cf02d4c8a6a8945c11c0851739388b1b3365810e34f4255337b120d0c8" exitCode=0
Jul 26 15:50:26.656999 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.656916    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"2a5dc9cf02d4c8a6a8945c11c0851739388b1b3365810e34f4255337b120d0c8"}
Jul 26 15:50:26.658869 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.658841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wtsdg" event={"ID":"81710507-45b0-4bfc-8b08-5da1dde7748d","Type":"ContainerStarted","Data":"0de0ef97f95232b3f24a8fb27ef30442248e1012f7c9cfdad9d6b6999b32626d"}
Jul 26 15:50:26.660613 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.660592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z" event={"ID":"6916878b-2fcb-4ada-a939-a4ea83c867a7","Type":"ContainerStarted","Data":"66e8f66eef73e708f769ab79974f18f4d6f0c3cd2e2368821f8c41ac48822b0e"}
Jul 26 15:50:26.662052 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.662029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cxsm" event={"ID":"881c71f7-fdde-492d-8603-6a37d31143ed","Type":"ContainerStarted","Data":"0188a00022b18cdc0f7197434e8d7c757e3e9b7d551cf40069cd4c023c9b9d56"}
Jul 26 15:50:26.665324 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"ac8a9e2bc3aa6044eaa88fbd517c4b9ccfc18e19bfada2f6ea185f1fffdc43de"}
Jul 26 15:50:26.665415 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665330    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"d6cc63628473ccb4c54c38625b1cff2f1f8adde29520a351825a2285e8634f2d"}
Jul 26 15:50:26.665415 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"0ef168fffb218e9c0867b56c5253939a24e42913689e45ab30fd8b363a7c642f"}
Jul 26 15:50:26.665525 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"afbc52e594bc6c1e0927f697e19b2970ae049d8f4228861bb19bf625e924893a"}
Jul 26 15:50:26.665525 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"a8e2f79cedcee4818bf8061110d72fffa2d5d42175f6c554c65b6050bb75b712"}
Jul 26 15:50:26.665525 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.665481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"bd30092a1723fd2f6475e16d454523b87456e47440e8183cb7cbd673c0fa1ff7"}
Jul 26 15:50:26.666736 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.666672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zhzjc" event={"ID":"689f9e49-860e-4a57-98d7-4cff20347277","Type":"ContainerStarted","Data":"9be1bf8e847ee22a8f23ae2c8aaa298bc96b0bc0b9817f9a8bd1b2ee4c445a2e"}
Jul 26 15:50:26.668325 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.668300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q7kfm" event={"ID":"f21ef924-2561-4319-9f87-2ddd8c29e3c7","Type":"ContainerStarted","Data":"2ef7cf71fadbdda11f0f7bfcad8866dc0a6d9e905a9177dd5955c308b3c072aa"}
Jul 26 15:50:26.669363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.669330    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-173.ec2.internal" podStartSLOduration=21.669318756 podStartE2EDuration="21.669318756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:09.639086078 +0000 UTC m=+5.577210412" watchObservedRunningTime="2026-07-26 15:50:26.669318756 +0000 UTC m=+22.607443124"
Jul 26 15:50:26.669789 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.669760    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gjx8b" podStartSLOduration=4.385599648 podStartE2EDuration="22.669752902s" totalImagesPullingTime="18.284153254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.669224475 +0000 UTC m=+22.607348816" watchObservedRunningTime="2026-07-26 15:50:26.669752902 +0000 UTC m=+22.607877223"
Jul 26 15:50:26.704182 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.704136    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q7kfm" podStartSLOduration=4.408982399 podStartE2EDuration="22.704124029s" totalImagesPullingTime="18.29514163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.703713732 +0000 UTC m=+22.641838059" watchObservedRunningTime="2026-07-26 15:50:26.704124029 +0000 UTC m=+22.642248358"
Jul 26 15:50:26.727733 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.727671    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wtsdg" podStartSLOduration=4.387574938 podStartE2EDuration="22.727659049s" totalImagesPullingTime="18.340084111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.727154564 +0000 UTC m=+22.665278908" watchObservedRunningTime="2026-07-26 15:50:26.727659049 +0000 UTC m=+22.665783380"
Jul 26 15:50:26.759661 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:26.759616    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7cxsm" podStartSLOduration=4.465877973 podStartE2EDuration="22.759599542s" totalImagesPullingTime="18.293721569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.744440373 +0000 UTC m=+22.682564703" watchObservedRunningTime="2026-07-26 15:50:26.759599542 +0000 UTC m=+22.697723874"
Jul 26 15:50:27.127318 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.127294    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 15:50:27.505979 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.505879    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T15:50:27.127312787Z","UUID":"d18a9c05-bcd0-4afe-bc1f-a3e7c79d2373","Handler":null,"Name":"","Endpoint":""}
Jul 26 15:50:27.507909 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.507868    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 15:50:27.508035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.507923    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 15:50:27.512828 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.512807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:27.513544 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.513526    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:27.529622 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.529578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zhzjc" podStartSLOduration=12.145007721 podStartE2EDuration="22.529562093s" totalImagesPullingTime="10.384554372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:26.759239487 +0000 UTC m=+22.697363819" watchObservedRunningTime="2026-07-26 15:50:27.529562093 +0000 UTC m=+23.467686425"
Jul 26 15:50:27.673334 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.673293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z" event={"ID":"6916878b-2fcb-4ada-a939-a4ea83c867a7","Type":"ContainerStarted","Data":"6ce947dd680e20a5791fb4b6de4d3cc930c19115558c37e0f55a075c85ecf92d"}
Jul 26 15:50:27.675785 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.675754    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b75wl" event={"ID":"b2621d71-bfb8-46af-a87e-e14bdae22f7e","Type":"ContainerStarted","Data":"bac31df538713585a9ef04f959100b7ee978fbce254a6b4f7aedcc32ea8392cd"}
Jul 26 15:50:27.676719 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.676699    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:27.677159 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.677129    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zhzjc"
Jul 26 15:50:27.690498 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:27.690453    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b75wl" podStartSLOduration=5.409792137 podStartE2EDuration="23.690437038s" totalImagesPullingTime="18.280644901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:27.689703118 +0000 UTC m=+23.627827442" watchObservedRunningTime="2026-07-26 15:50:27.690437038 +0000 UTC m=+23.628561367"
Jul 26 15:50:28.555241 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.555204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:28.555350 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:28.555335    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:28.555413 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.555396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:28.555504 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:28.555484    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:28.555568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.555198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:28.555622 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:28.555579    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:28.680756 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.680714    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z" event={"ID":"6916878b-2fcb-4ada-a939-a4ea83c867a7","Type":"ContainerStarted","Data":"eb0927267dd1f8593c4fd0696e4294bb051aaed14e61033bba5e845faa36bd3f"}
Jul 26 15:50:28.684822 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.684785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"96c5f644bd32efef254f913d7a92c365de41106745d37d7d9f1d13a854ea254f"}
Jul 26 15:50:28.697142 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:28.697104    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j5z2z" podStartSLOduration=4.3714205 podStartE2EDuration="24.69709061s" totalImagesPullingTime="20.32567011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:28.696744366 +0000 UTC m=+24.634868697" watchObservedRunningTime="2026-07-26 15:50:28.69709061 +0000 UTC m=+24.635214941"
Jul 26 15:50:30.554867 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:30.554672    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:30.555581 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:30.554677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:30.555581 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:30.554754    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:30.555581 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:30.555028    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:30.555581 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:30.555351    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:30.555812 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:30.554973    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:31.692943 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.692911    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="32ec7c9412912b26edd70897897636fb9222b19ed2bc8bd0de41fe48b3e6309f" exitCode=0
Jul 26 15:50:31.693817 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.692999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"32ec7c9412912b26edd70897897636fb9222b19ed2bc8bd0de41fe48b3e6309f"}
Jul 26 15:50:31.696791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.696634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" event={"ID":"567ad180-788f-4366-bafc-cd0cb966a0da","Type":"ContainerStarted","Data":"8bc7dbfdbcb3d4b41e00f62da0a1642d7f7ef27c7cd516992b887abcb8d993c7"}
Jul 26 15:50:31.696891 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.696862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:31.696959 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.696947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:31.697023 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.697002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:31.711458 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.711440    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:31.711544 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.711523    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:50:31.771549 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:31.771507    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b8686" podStartSLOduration=9.422839481 podStartE2EDuration="27.771494299s" totalImagesPullingTime="18.348654818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:31.771308524 +0000 UTC m=+27.709432856" watchObservedRunningTime="2026-07-26 15:50:31.771494299 +0000 UTC m=+27.709618630"
Jul 26 15:50:32.554078 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:32.554048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:32.554280 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:32.554048    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:32.554280 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:32.554146    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:32.554280 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:32.554172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:32.554432 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:32.554274    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:32.554432 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:32.554355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:33.025616 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.025587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qfqv"]
Jul 26 15:50:33.025999 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.025747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:33.025999 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:33.025831    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:33.029068 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.029046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzrx8"]
Jul 26 15:50:33.029182 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.029132    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:33.029233 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:33.029216    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:33.029889 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.029865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5twbk"]
Jul 26 15:50:33.029992 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.029966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:33.030047 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:33.030034    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:33.702790 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.702756    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="c4807fe99fc5e5464d20007e768ee6442386d13164f82eedc01d5525df02360e" exitCode=0
Jul 26 15:50:33.702977 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:33.702844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"c4807fe99fc5e5464d20007e768ee6442386d13164f82eedc01d5525df02360e"}
Jul 26 15:50:34.556111 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:34.556075    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:34.556485 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:34.556187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:34.556485 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:34.556204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:34.556485 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:34.556205    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:34.556485 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:34.556281    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:34.556485 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:34.556371    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:35.709678 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:35.709498    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="554ace3d0d80679958366b703eaff1ffc3ca5eb02819f37486c020cdbfc22c62" exitCode=0
Jul 26 15:50:35.710036 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:35.709588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"554ace3d0d80679958366b703eaff1ffc3ca5eb02819f37486c020cdbfc22c62"}
Jul 26 15:50:36.554874 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:36.554842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:36.555051 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:36.554878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:36.555051 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:36.554893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:36.555051 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:36.554997    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:36.555206 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:36.555063    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:36.555206 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:36.555094    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:38.195194 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.195160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.195209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195323    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195400    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs podName:b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c nodeName:}" failed. No retries permitted until 2026-07-26 15:51:10.195379217 +0000 UTC m=+66.133503539 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs") pod "network-metrics-daemon-5twbk" (UID: "b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195325    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195452    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195467    2576 projected.go:196] Error preparing data for projected volume kube-api-access-2gv68 for pod openshift-network-diagnostics/network-check-target-xzrx8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:38.195722 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.195517    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68 podName:226f03d2-be7e-413c-9b17-27c95adddbd7 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:10.195503218 +0000 UTC m=+66.133627530 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2gv68" (UniqueName: "kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68") pod "network-check-target-xzrx8" (UID: "226f03d2-be7e-413c-9b17-27c95adddbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 15:50:38.296189 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.296156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:38.296353 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.296276    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:38.296353 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.296334    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret podName:ad2d4624-43e8-4832-a099-d8d88e62aa3b nodeName:}" failed. No retries permitted until 2026-07-26 15:51:10.296319004 +0000 UTC m=+66.234443313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret") pod "global-pull-secret-syncer-4qfqv" (UID: "ad2d4624-43e8-4832-a099-d8d88e62aa3b") : object "kube-system"/"original-pull-secret" not registered
Jul 26 15:50:38.554304 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.554272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:38.554304 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.554302    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:38.554535 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:38.554272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:38.554535 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.554406    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5twbk" podUID="b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c"
Jul 26 15:50:38.554535 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.554496    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qfqv" podUID="ad2d4624-43e8-4832-a099-d8d88e62aa3b"
Jul 26 15:50:38.554733 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:38.554582    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzrx8" podUID="226f03d2-be7e-413c-9b17-27c95adddbd7"
Jul 26 15:50:39.379326 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.379296    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-173.ec2.internal" event="NodeReady"
Jul 26 15:50:39.379908 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.379458    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 15:50:39.411978 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.411950    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"]
Jul 26 15:50:39.415660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.415637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.417961 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.417936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 15:50:39.418077 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.417939    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rcvjj\""
Jul 26 15:50:39.418077 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.417939    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 15:50:39.418415 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.418393    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 15:50:39.421977 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.421955    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p7dm4"]
Jul 26 15:50:39.423216 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.423196    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 15:50:39.425394 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.425374    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8n7jx"]
Jul 26 15:50:39.425519 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.425502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.427929 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.427783    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 15:50:39.427929 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.427836    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cx8dk\""
Jul 26 15:50:39.427929 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.427842    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 15:50:39.428972 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.428955    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"]
Jul 26 15:50:39.429067 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.429036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.431255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.431239    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 15:50:39.431255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.431246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 15:50:39.431425 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.431406    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 15:50:39.431554 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.431478    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-69pk7\""
Jul 26 15:50:39.436892 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.436871    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p7dm4"]
Jul 26 15:50:39.437453 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.437436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8n7jx"]
Jul 26 15:50:39.505295 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhps7\" (UniqueName: \"kubernetes.io/projected/d0204351-51f1-45f9-a806-a01d00ab335b-kube-api-access-mhps7\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.505454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0204351-51f1-45f9-a806-a01d00ab335b-config-volume\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.505454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0204351-51f1-45f9-a806-a01d00ab335b-tmp-dir\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.505454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vshn\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.505721 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.505717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606386 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606386 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.606386 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vshn\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606463    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:39.606473    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:39.606551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:40.106529528 +0000 UTC m=+36.044653839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:39.606592    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.606622 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:39.606604    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:39.606654    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:50:40.106630232 +0000 UTC m=+36.044754544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhps7\" (UniqueName: \"kubernetes.io/projected/d0204351-51f1-45f9-a806-a01d00ab335b-kube-api-access-mhps7\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606737    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18cb9c03-c7f6-43b0-9c1f-434855320602-cert\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbrkq\" (UniqueName: \"kubernetes.io/projected/18cb9c03-c7f6-43b0-9c1f-434855320602-kube-api-access-qbrkq\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0204351-51f1-45f9-a806-a01d00ab335b-config-volume\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0204351-51f1-45f9-a806-a01d00ab335b-tmp-dir\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.606898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.607014 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.607001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.607477 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.607349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0204351-51f1-45f9-a806-a01d00ab335b-tmp-dir\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.607533 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.607497    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.607623 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.607602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0204351-51f1-45f9-a806-a01d00ab335b-config-volume\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.607738 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.607719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.610497 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.610477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.610573 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.610500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.614909 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.614863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhps7\" (UniqueName: \"kubernetes.io/projected/d0204351-51f1-45f9-a806-a01d00ab335b-kube-api-access-mhps7\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:39.615010 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.614990    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vshn\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.615057 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.615036    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:39.708128 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.708100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18cb9c03-c7f6-43b0-9c1f-434855320602-cert\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.708240 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.708142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbrkq\" (UniqueName: \"kubernetes.io/projected/18cb9c03-c7f6-43b0-9c1f-434855320602-kube-api-access-qbrkq\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.710806 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.710781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18cb9c03-c7f6-43b0-9c1f-434855320602-cert\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.717083 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.717064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbrkq\" (UniqueName: \"kubernetes.io/projected/18cb9c03-c7f6-43b0-9c1f-434855320602-kube-api-access-qbrkq\") pod \"ingress-canary-8n7jx\" (UID: \"18cb9c03-c7f6-43b0-9c1f-434855320602\") " pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.745061 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.744886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8n7jx"
Jul 26 15:50:39.884502 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:39.884423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8n7jx"]
Jul 26 15:50:39.900521 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:50:39.900498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18cb9c03_c7f6_43b0_9c1f_434855320602.slice/crio-1f6c5ae0bde3fdd88ba6af1f9b67943ed05740d7d7d5e90fef852e669b15df81 WatchSource:0}: Error finding container 1f6c5ae0bde3fdd88ba6af1f9b67943ed05740d7d7d5e90fef852e669b15df81: Status 404 returned error can't find the container with id 1f6c5ae0bde3fdd88ba6af1f9b67943ed05740d7d7d5e90fef852e669b15df81
Jul 26 15:50:40.110713 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.110647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:40.110864 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.110749    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:40.110864 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:40.110796    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:40.110929 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:40.110873    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.110857067 +0000 UTC m=+37.048981380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:40.110929 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:40.110874    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:40.110929 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:40.110887    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:40.110929 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:40.110928    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:50:41.110912852 +0000 UTC m=+37.049037183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:50:40.554455 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.554421    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:50:40.555119 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.554427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:50:40.555119 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.554625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:50:40.556745 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.556727    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:50:40.557379 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.557364    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r7gjf\""
Jul 26 15:50:40.557455 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.557383    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:50:40.557659 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.557641    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:50:40.557754 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.557697    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h9x\""
Jul 26 15:50:40.557754 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.557721    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:50:40.722735 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.722668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8n7jx" event={"ID":"18cb9c03-c7f6-43b0-9c1f-434855320602","Type":"ContainerStarted","Data":"1f6c5ae0bde3fdd88ba6af1f9b67943ed05740d7d7d5e90fef852e669b15df81"}
Jul 26 15:50:40.725202 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.725181    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="fec631fd9f05ae3ca4b287db25023a495b0b5fdbbbf700eb87c0bfe6f689e615" exitCode=0
Jul 26 15:50:40.725306 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:40.725225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"fec631fd9f05ae3ca4b287db25023a495b0b5fdbbbf700eb87c0bfe6f689e615"}
Jul 26 15:50:41.119072 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:41.118994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:41.119238 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:41.119087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:41.119238 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:41.119161    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:41.119238 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:41.119185    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:41.119238 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:41.119193    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:41.119412 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:41.119246    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:43.119228439 +0000 UTC m=+39.057352761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:41.119412 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:41.119264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:50:43.119254945 +0000 UTC m=+39.057379253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:50:41.731274 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:41.731231    2576 generic.go:356] "Generic (PLEG): container finished" podID="9db49ed9-01db-4772-b03c-6a1d40b6b046" containerID="048279fad1f75cc1dcc204679484c803a1f7365e3be203d21212e001475bf18a" exitCode=0
Jul 26 15:50:41.731764 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:41.731283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerDied","Data":"048279fad1f75cc1dcc204679484c803a1f7365e3be203d21212e001475bf18a"}
Jul 26 15:50:42.734993 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:42.734805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8n7jx" event={"ID":"18cb9c03-c7f6-43b0-9c1f-434855320602","Type":"ContainerStarted","Data":"0a2d9bb51eeb797249f0f33e93c9fbcd1298aa4ccbfbc3c9283c167e6a25953a"}
Jul 26 15:50:42.738547 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:42.738519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" event={"ID":"9db49ed9-01db-4772-b03c-6a1d40b6b046","Type":"ContainerStarted","Data":"51360f441887182ea51b6e167eb0615707614ecaea860ed74b92be9f5b418ac0"}
Jul 26 15:50:42.764937 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:42.764876    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hhvgc" podStartSLOduration=10.313989378 podStartE2EDuration="38.764852717s" totalImagesPullingTime="28.450863339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:42.762899109 +0000 UTC m=+38.701023440" watchObservedRunningTime="2026-07-26 15:50:42.764852717 +0000 UTC m=+38.702977047"
Jul 26 15:50:43.135412 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:43.135375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:43.135564 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:43.135447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:43.135564 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:43.135544    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:43.135626 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:43.135568    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:43.135626 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:43.135579    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:43.135626 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:43.135614    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:47.13559513 +0000 UTC m=+43.073719443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:43.135770 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:43.135629    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:50:47.135622775 +0000 UTC m=+43.073747083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:50:43.756648 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:43.756595    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8n7jx" podStartSLOduration=2.050192708 podStartE2EDuration="4.756578462s" totalImagesPullingTime="2.706385754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:50:43.755656799 +0000 UTC m=+39.693781130" watchObservedRunningTime="2026-07-26 15:50:43.756578462 +0000 UTC m=+39.694702792"
Jul 26 15:50:47.162744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:47.162664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:47.162767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:47.162821    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:47.162871    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:47.162881    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:47.162884    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:50:55.162869521 +0000 UTC m=+51.100993830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:47.163099 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:47.162915    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:50:55.162905313 +0000 UTC m=+51.101029622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:50:55.218857 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:55.218825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:50:55.218877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") pod \"image-registry-7dfc6b5b88-vgp9f\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") " pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:55.218954    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:55.218986    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:55.218997    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfc6b5b88-vgp9f: secret "image-registry-tls" not found
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:55.219023    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls podName:d0204351-51f1-45f9-a806-a01d00ab335b nodeName:}" failed. No retries permitted until 2026-07-26 15:51:11.219008052 +0000 UTC m=+67.157132360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls") pod "dns-default-p7dm4" (UID: "d0204351-51f1-45f9-a806-a01d00ab335b") : secret "dns-default-metrics-tls" not found
Jul 26 15:50:55.219293 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:50:55.219047    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls podName:4e8404d9-bc8a-4422-bcc2-08deefeb8e2d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:11.219034794 +0000 UTC m=+67.157159138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls") pod "image-registry-7dfc6b5b88-vgp9f" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d") : secret "image-registry-tls" not found
Jul 26 15:51:03.712756 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:03.712727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b8686"
Jul 26 15:51:08.946043 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.946014    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dd998b55c-hwxgl"]
Jul 26 15:51:08.948808 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.948786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:08.951612 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.951591    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 26 15:51:08.951901 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.951883    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 15:51:08.951997 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.951923    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 26 15:51:08.952131 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.952117    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 15:51:08.952400 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.952385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ckx9d\""
Jul 26 15:51:08.952773 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.952758    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 26 15:51:08.952773 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.952770    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 26 15:51:08.962787 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.962770    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"]
Jul 26 15:51:08.964600 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.964587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:08.967218 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.967196    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 15:51:08.967296 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.967244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 15:51:08.967461 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.967445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 26 15:51:08.967540 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.967452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 15:51:08.968047 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.968030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dd998b55c-hwxgl"]
Jul 26 15:51:08.981525 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:08.981502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"]
Jul 26 15:51:09.021284 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6168d221-2589-4df0-a000-3ba5eeeb4234-tmp\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.021389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-metrics-certs\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.021389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbjfc\" (UniqueName: \"kubernetes.io/projected/6168d221-2589-4df0-a000-3ba5eeeb4234-kube-api-access-pbjfc\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.021389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-stats-auth\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.021389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhgkn\" (UniqueName: \"kubernetes.io/projected/ced0987f-8eec-4c83-975f-b82334f37e44-kube-api-access-dhgkn\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.021389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ced0987f-8eec-4c83-975f-b82334f37e44-service-ca-bundle\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.021539 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6168d221-2589-4df0-a000-3ba5eeeb4234-klusterlet-config\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.021539 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.021459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-default-certificate\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.039574 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.039545    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"]
Jul 26 15:51:09.042355 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.042338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.045480 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.045460    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4tbcm\""
Jul 26 15:51:09.045582 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.045518    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 15:51:09.045582 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.045528    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 15:51:09.045723 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.045624    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 26 15:51:09.045723 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.045663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 26 15:51:09.046015 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.046001    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-szrcf"]
Jul 26 15:51:09.047562 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.047546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:09.049921 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.049906    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 26 15:51:09.050416 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.050401    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 26 15:51:09.050482 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.050402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-p4wt2\""
Jul 26 15:51:09.055170 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.055152    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"]
Jul 26 15:51:09.055348 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:09.055329    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f" podUID="4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"
Jul 26 15:51:09.056239 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.056221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"]
Jul 26 15:51:09.060113 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.060094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-szrcf"]
Jul 26 15:51:09.122386 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6168d221-2589-4df0-a000-3ba5eeeb4234-klusterlet-config\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.122494 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122401    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.122494 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.122494 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-default-certificate\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.122604 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122509    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6168d221-2589-4df0-a000-3ba5eeeb4234-tmp\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.122604 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-metrics-certs\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.122604 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xw6\" (UniqueName: \"kubernetes.io/projected/840bbf17-b5e3-4b45-8dea-d19912a24860-kube-api-access-h9xw6\") pod \"downloads-7c97dc4555-szrcf\" (UID: \"840bbf17-b5e3-4b45-8dea-d19912a24860\") " pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:09.122766 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbjfc\" (UniqueName: \"kubernetes.io/projected/6168d221-2589-4df0-a000-3ba5eeeb4234-kube-api-access-pbjfc\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.122820 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-stats-auth\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.122872 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhgkn\" (UniqueName: \"kubernetes.io/projected/ced0987f-8eec-4c83-975f-b82334f37e44-kube-api-access-dhgkn\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.122872 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9xq8\" (UniqueName: \"kubernetes.io/projected/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-kube-api-access-h9xq8\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.122970 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ced0987f-8eec-4c83-975f-b82334f37e44-service-ca-bundle\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.122970 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.122935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6168d221-2589-4df0-a000-3ba5eeeb4234-tmp\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.123530 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.123510    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ced0987f-8eec-4c83-975f-b82334f37e44-service-ca-bundle\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.126351 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.126329    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-metrics-certs\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.126424 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.126370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-stats-auth\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.126464 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.126445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6168d221-2589-4df0-a000-3ba5eeeb4234-klusterlet-config\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.126464 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.126449    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ced0987f-8eec-4c83-975f-b82334f37e44-default-certificate\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.134347 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.134326    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhgkn\" (UniqueName: \"kubernetes.io/projected/ced0987f-8eec-4c83-975f-b82334f37e44-kube-api-access-dhgkn\") pod \"router-default-5dd998b55c-hwxgl\" (UID: \"ced0987f-8eec-4c83-975f-b82334f37e44\") " pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.135812 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.135796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbjfc\" (UniqueName: \"kubernetes.io/projected/6168d221-2589-4df0-a000-3ba5eeeb4234-kube-api-access-pbjfc\") pod \"klusterlet-addon-workmgr-79474f6666-92cgj\" (UID: \"6168d221-2589-4df0-a000-3ba5eeeb4234\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.138850 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.138831    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f84cf8886-6sjvn"]
Jul 26 15:51:09.141134 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.141117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.154786 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.154767    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f84cf8886-6sjvn"]
Jul 26 15:51:09.223524 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-trusted-ca\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223626 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-bound-sa-token\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223626 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-installation-pull-secrets\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xw6\" (UniqueName: \"kubernetes.io/projected/840bbf17-b5e3-4b45-8dea-d19912a24860-kube-api-access-h9xw6\") pod \"downloads-7c97dc4555-szrcf\" (UID: \"840bbf17-b5e3-4b45-8dea-d19912a24860\") " pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:09.223744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-tls\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9xq8\" (UniqueName: \"kubernetes.io/projected/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-kube-api-access-h9xq8\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.223744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgxz\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-kube-api-access-wjgxz\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223744 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-certificates\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223943 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.223943 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-image-registry-private-configuration\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.223943 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.224051 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.223957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-ca-trust-extracted\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.224405 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.224389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.226105 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.226084    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.248704 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.233340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xw6\" (UniqueName: \"kubernetes.io/projected/840bbf17-b5e3-4b45-8dea-d19912a24860-kube-api-access-h9xw6\") pod \"downloads-7c97dc4555-szrcf\" (UID: \"840bbf17-b5e3-4b45-8dea-d19912a24860\") " pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:09.248704 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.235857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9xq8\" (UniqueName: \"kubernetes.io/projected/67abce95-3575-49e8-a3cf-e77bc3ea6f1b-kube-api-access-h9xq8\") pod \"cluster-monitoring-operator-548b489cb8-2dvl8\" (UID: \"67abce95-3575-49e8-a3cf-e77bc3ea6f1b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.258035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.258011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:09.272897 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.272878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.324956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-image-registry-private-configuration\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-ca-trust-extracted\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-trusted-ca\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-bound-sa-token\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-installation-pull-secrets\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325172    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-tls\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgxz\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-kube-api-access-wjgxz\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.325238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-certificates\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.326401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-certificates\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.327041    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-ca-trust-extracted\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328163 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.327851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-trusted-ca\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.328961 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.328638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-image-registry-private-configuration\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.330079 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.330052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-installation-pull-secrets\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.330642 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.330623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-registry-tls\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.336561 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.336517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgxz\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-kube-api-access-wjgxz\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.337872 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.337851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abc7523-bbe0-4708-8a69-97ec1bf10f1d-bound-sa-token\") pod \"image-registry-f84cf8886-6sjvn\" (UID: \"7abc7523-bbe0-4708-8a69-97ec1bf10f1d\") " pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.350316 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.350286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"
Jul 26 15:51:09.360868 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.357245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:09.410317 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.408362    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dd998b55c-hwxgl"]
Jul 26 15:51:09.410317 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.410163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"]
Jul 26 15:51:09.417217 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:09.416666    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6168d221_2589_4df0_a000_3ba5eeeb4234.slice/crio-1e798e4059f1fd157308e8086cb42b22ef2e4d716f9ea5ef5aa7f50f82967448 WatchSource:0}: Error finding container 1e798e4059f1fd157308e8086cb42b22ef2e4d716f9ea5ef5aa7f50f82967448: Status 404 returned error can't find the container with id 1e798e4059f1fd157308e8086cb42b22ef2e4d716f9ea5ef5aa7f50f82967448
Jul 26 15:51:09.417217 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:09.417194    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced0987f_8eec_4c83_975f_b82334f37e44.slice/crio-97482301617a778c94ba101beb5dac5672682c043ddb98184735becb8118b8bd WatchSource:0}: Error finding container 97482301617a778c94ba101beb5dac5672682c043ddb98184735becb8118b8bd: Status 404 returned error can't find the container with id 97482301617a778c94ba101beb5dac5672682c043ddb98184735becb8118b8bd
Jul 26 15:51:09.452881 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.452857    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rcvjj\""
Jul 26 15:51:09.460510 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.460484    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.491612 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.491581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8"]
Jul 26 15:51:09.496018 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:09.495990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67abce95_3575_49e8_a3cf_e77bc3ea6f1b.slice/crio-38bebb1d6786a7b797749e34ac9187b85956eaddafaa411db6672dcd83f117c2 WatchSource:0}: Error finding container 38bebb1d6786a7b797749e34ac9187b85956eaddafaa411db6672dcd83f117c2: Status 404 returned error can't find the container with id 38bebb1d6786a7b797749e34ac9187b85956eaddafaa411db6672dcd83f117c2
Jul 26 15:51:09.513414 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.513382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-szrcf"]
Jul 26 15:51:09.517369 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:09.517344    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840bbf17_b5e3_4b45_8dea_d19912a24860.slice/crio-49f3c9d04588a00e9f4286818dfda4edaa1856a405309d53aa82cb2f6acf8ccb WatchSource:0}: Error finding container 49f3c9d04588a00e9f4286818dfda4edaa1856a405309d53aa82cb2f6acf8ccb: Status 404 returned error can't find the container with id 49f3c9d04588a00e9f4286818dfda4edaa1856a405309d53aa82cb2f6acf8ccb
Jul 26 15:51:09.602953 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.602924    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f84cf8886-6sjvn"]
Jul 26 15:51:09.605857 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:09.605831    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abc7523_bbe0_4708_8a69_97ec1bf10f1d.slice/crio-e1c1f249c69488372e88fbcf10099a848c05b6e6f051c030d168d6c82c8f2e54 WatchSource:0}: Error finding container e1c1f249c69488372e88fbcf10099a848c05b6e6f051c030d168d6c82c8f2e54: Status 404 returned error can't find the container with id e1c1f249c69488372e88fbcf10099a848c05b6e6f051c030d168d6c82c8f2e54
Jul 26 15:51:09.799334 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.799246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dd998b55c-hwxgl" event={"ID":"ced0987f-8eec-4c83-975f-b82334f37e44","Type":"ContainerStarted","Data":"daf278c6ae176e08871cfede3a0191d9a59b446cdebd83173d04962869c98ce7"}
Jul 26 15:51:09.799334 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.799305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dd998b55c-hwxgl" event={"ID":"ced0987f-8eec-4c83-975f-b82334f37e44","Type":"ContainerStarted","Data":"97482301617a778c94ba101beb5dac5672682c043ddb98184735becb8118b8bd"}
Jul 26 15:51:09.800736 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.800713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn" event={"ID":"7abc7523-bbe0-4708-8a69-97ec1bf10f1d","Type":"ContainerStarted","Data":"f1a87d942211698d51e10e46ce7c81731d2eaacdc9160b21e9fde30f46957200"}
Jul 26 15:51:09.800860 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.800749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn" event={"ID":"7abc7523-bbe0-4708-8a69-97ec1bf10f1d","Type":"ContainerStarted","Data":"e1c1f249c69488372e88fbcf10099a848c05b6e6f051c030d168d6c82c8f2e54"}
Jul 26 15:51:09.800860 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.800807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:09.801827 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.801799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj" event={"ID":"6168d221-2589-4df0-a000-3ba5eeeb4234","Type":"ContainerStarted","Data":"1e798e4059f1fd157308e8086cb42b22ef2e4d716f9ea5ef5aa7f50f82967448"}
Jul 26 15:51:09.802970 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.802945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-szrcf" event={"ID":"840bbf17-b5e3-4b45-8dea-d19912a24860","Type":"ContainerStarted","Data":"49f3c9d04588a00e9f4286818dfda4edaa1856a405309d53aa82cb2f6acf8ccb"}
Jul 26 15:51:09.803973 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.803955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8" event={"ID":"67abce95-3575-49e8-a3cf-e77bc3ea6f1b","Type":"ContainerStarted","Data":"38bebb1d6786a7b797749e34ac9187b85956eaddafaa411db6672dcd83f117c2"}
Jul 26 15:51:09.804052 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.803982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:51:09.808914 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.808898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:51:09.816840 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.816794    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5dd998b55c-hwxgl" podStartSLOduration=1.8167775320000001 podStartE2EDuration="1.816777532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:09.815626476 +0000 UTC m=+65.753750806" watchObservedRunningTime="2026-07-26 15:51:09.816777532 +0000 UTC m=+65.754901865"
Jul 26 15:51:09.828785 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828758    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.828873 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vshn\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.828873 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.828946 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828890    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.828946 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828921    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.829091 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.828947    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.829091 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.829008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets\") pod \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\" (UID: \"4e8404d9-bc8a-4422-bcc2-08deefeb8e2d\") "
Jul 26 15:51:09.829272 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.829247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 15:51:09.829410 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.829396    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-ca-trust-extracted\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.829465 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.829411    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:09.830124 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.830100    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:09.831256 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.831232    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn" (OuterVolumeSpecName: "kube-api-access-2vshn") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "kube-api-access-2vshn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:09.831348 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.831267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:09.831899 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.831880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:09.832228 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.832212    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" (UID: "4e8404d9-bc8a-4422-bcc2-08deefeb8e2d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:09.838618 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.838571    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn" podStartSLOduration=0.838553691 podStartE2EDuration="838.553691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:09.837727727 +0000 UTC m=+65.775852056" watchObservedRunningTime="2026-07-26 15:51:09.838553691 +0000 UTC m=+65.776678024"
Jul 26 15:51:09.930035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930005    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-bound-sa-token\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.930035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930032    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vshn\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-kube-api-access-2vshn\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.930209 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930048    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-image-registry-private-configuration\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.930209 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930059    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-certificates\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.930209 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930067    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-trusted-ca\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:09.930209 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:09.930077    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-installation-pull-secrets\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:10.231985 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.231947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:51:10.232390 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.232011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:51:10.234962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.234535    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 15:51:10.234962 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.234810    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 15:51:10.245076 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.244898    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 15:51:10.245568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.245541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c-metrics-certs\") pod \"network-metrics-daemon-5twbk\" (UID: \"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c\") " pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:51:10.257763 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.257737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gv68\" (UniqueName: \"kubernetes.io/projected/226f03d2-be7e-413c-9b17-27c95adddbd7-kube-api-access-2gv68\") pod \"network-check-target-xzrx8\" (UID: \"226f03d2-be7e-413c-9b17-27c95adddbd7\") " pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:51:10.258510 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.258481    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:10.261841 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.261809    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:10.271434 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.271415    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r7gjf\""
Jul 26 15:51:10.277162 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.277144    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h9x\""
Jul 26 15:51:10.282352 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.281888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5twbk"
Jul 26 15:51:10.285767 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.285748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:51:10.333784 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.333381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:51:10.336153 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.335894    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 15:51:10.359332 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.359264    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad2d4624-43e8-4832-a099-d8d88e62aa3b-original-pull-secret\") pod \"global-pull-secret-syncer-4qfqv\" (UID: \"ad2d4624-43e8-4832-a099-d8d88e62aa3b\") " pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:51:10.475568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.475538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzrx8"]
Jul 26 15:51:10.479339 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:10.479311    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226f03d2_be7e_413c_9b17_27c95adddbd7.slice/crio-d43a88099e16f399ad0d67ae58e0a71f00839218099bb92bd5d5843c3828f7e0 WatchSource:0}: Error finding container d43a88099e16f399ad0d67ae58e0a71f00839218099bb92bd5d5843c3828f7e0: Status 404 returned error can't find the container with id d43a88099e16f399ad0d67ae58e0a71f00839218099bb92bd5d5843c3828f7e0
Jul 26 15:51:10.487512 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.487488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5twbk"]
Jul 26 15:51:10.493141 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:10.493107    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a0213c_44b0_4ab3_a0c6_0fe3716fd35c.slice/crio-97e8deda78df4ddde401cc2286ff62c617d9f5cd6397001044fec40e995eea0d WatchSource:0}: Error finding container 97e8deda78df4ddde401cc2286ff62c617d9f5cd6397001044fec40e995eea0d: Status 404 returned error can't find the container with id 97e8deda78df4ddde401cc2286ff62c617d9f5cd6397001044fec40e995eea0d
Jul 26 15:51:10.566380 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.566165    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qfqv"
Jul 26 15:51:10.730022 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.729993    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qfqv"]
Jul 26 15:51:10.736124 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:10.735510    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2d4624_43e8_4832_a099_d8d88e62aa3b.slice/crio-d8c9a25332670847033ab8c2e971a1a3ca9b17a45af7de2cf4173a3567f8b04f WatchSource:0}: Error finding container d8c9a25332670847033ab8c2e971a1a3ca9b17a45af7de2cf4173a3567f8b04f: Status 404 returned error can't find the container with id d8c9a25332670847033ab8c2e971a1a3ca9b17a45af7de2cf4173a3567f8b04f
Jul 26 15:51:10.809596 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.809511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qfqv" event={"ID":"ad2d4624-43e8-4832-a099-d8d88e62aa3b","Type":"ContainerStarted","Data":"d8c9a25332670847033ab8c2e971a1a3ca9b17a45af7de2cf4173a3567f8b04f"}
Jul 26 15:51:10.811875 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.811843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5twbk" event={"ID":"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c","Type":"ContainerStarted","Data":"97e8deda78df4ddde401cc2286ff62c617d9f5cd6397001044fec40e995eea0d"}
Jul 26 15:51:10.814504 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.814197    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzrx8" event={"ID":"226f03d2-be7e-413c-9b17-27c95adddbd7","Type":"ContainerStarted","Data":"d43a88099e16f399ad0d67ae58e0a71f00839218099bb92bd5d5843c3828f7e0"}
Jul 26 15:51:10.814504 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.814278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"
Jul 26 15:51:10.815332 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.815269    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:10.816922 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.816882    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dd998b55c-hwxgl"
Jul 26 15:51:10.867972 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.867939    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"]
Jul 26 15:51:10.871797 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.871770    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dfc6b5b88-vgp9f"]
Jul 26 15:51:10.938122 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:10.938093    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d-registry-tls\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:11.241443 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:11.241004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:51:11.245167 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:11.245114    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0204351-51f1-45f9-a806-a01d00ab335b-metrics-tls\") pod \"dns-default-p7dm4\" (UID: \"d0204351-51f1-45f9-a806-a01d00ab335b\") " pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:51:11.541255 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:11.541014    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cx8dk\""
Jul 26 15:51:11.549449 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:11.549212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:51:12.560394 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.560171    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8404d9-bc8a-4422-bcc2-08deefeb8e2d" path="/var/lib/kubelet/pods/4e8404d9-bc8a-4422-bcc2-08deefeb8e2d/volumes"
Jul 26 15:51:12.814700 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.813658    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:12.838738 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.838590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:12.840178 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.838951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.842477 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.841978    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-59gbz\""
Jul 26 15:51:12.842477 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.842172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 26 15:51:12.842477 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.842333    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 26 15:51:12.843418 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.842960    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 26 15:51:12.843418 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.843166    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 26 15:51:12.843418 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.843328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bftht\" (UniqueName: \"kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.855729 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.855594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.956846 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.957033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.957033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.957033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bftht\" (UniqueName: \"kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.957033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.957033 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.956973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.958369 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.958047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.958369 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.958158    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.958764 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.958738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.965522 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.965434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.968645 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.968620    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bftht\" (UniqueName: \"kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:12.972412 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:12.972350    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config\") pod \"console-7445bfb8-l8xm4\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") " pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:13.153810 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:13.153499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:14.492392 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.492359    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5c4hg"]
Jul 26 15:51:14.495053 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.494591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.497273 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.496987    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 15:51:14.497273 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.497134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 15:51:14.497440 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.497338    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 15:51:14.497868 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.497848    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 15:51:14.498145 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.498126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lf682\""
Jul 26 15:51:14.505250 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.505191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5c4hg"]
Jul 26 15:51:14.569958 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.569927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.570129 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.569990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28qk\" (UniqueName: \"kubernetes.io/projected/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-api-access-b28qk\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.570129 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.570019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/704ace0b-a257-4b4e-9199-5c62e4c2e19d-data-volume\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.570129 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.570080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/704ace0b-a257-4b4e-9199-5c62e4c2e19d-crio-socket\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.570283 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.570160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671130 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28qk\" (UniqueName: \"kubernetes.io/projected/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-api-access-b28qk\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671364 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671146    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/704ace0b-a257-4b4e-9199-5c62e4c2e19d-data-volume\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671364 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/704ace0b-a257-4b4e-9199-5c62e4c2e19d-crio-socket\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671364 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671364 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671364 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:14.671354    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:14.671610 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:14.671417    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:15.171397151 +0000 UTC m=+71.109521459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:14.671610 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/704ace0b-a257-4b4e-9199-5c62e4c2e19d-crio-socket\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.671610 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:14.671591    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:14.671788 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:14.671626    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:15.171615018 +0000 UTC m=+71.109739329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:14.671852 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.671825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/704ace0b-a257-4b4e-9199-5c62e4c2e19d-data-volume\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:14.681394 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:14.681367    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28qk\" (UniqueName: \"kubernetes.io/projected/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-api-access-b28qk\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:15.175747 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:15.175705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:15.175951 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:15.175780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:15.175951 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:15.175808    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:15.175951 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:15.175867    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:15.175951 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:15.175878    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:16.175858832 +0000 UTC m=+72.113983150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:15.175951 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:15.175953    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:16.175935793 +0000 UTC m=+72.114060102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:15.561241 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:15.561173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:16.185738 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:16.185679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:16.185936 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:16.185795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:16.185936 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:16.185801    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:16.185936 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:16.185896    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:18.185876718 +0000 UTC m=+74.124001042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:16.185936 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:16.185913    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:16.186157 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:16.185975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:18.185960414 +0000 UTC m=+74.124084727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:16.291647 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:16.291615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjx8b_5ff48070-2040-4d65-9ae1-3d2e695b3ebb/dns-node-resolver/0.log"
Jul 26 15:51:17.093929 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:17.093903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f84cf8886-6sjvn_7abc7523-bbe0-4708-8a69-97ec1bf10f1d/registry/0.log"
Jul 26 15:51:17.492051 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:17.492025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q7kfm_f21ef924-2561-4319-9f87-2ddd8c29e3c7/node-ca/0.log"
Jul 26 15:51:17.892294 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:17.892177    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dd998b55c-hwxgl_ced0987f-8eec-4c83-975f-b82334f37e44/router/0.log"
Jul 26 15:51:18.092127 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.092050    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8n7jx_18cb9c03-c7f6-43b0-9c1f-434855320602/serve-healthcheck-canary/0.log"
Jul 26 15:51:18.203400 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.203237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:18.203400 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.203285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:18.203400 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:18.203361    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:18.203972 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:18.203416    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:18.203972 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:18.203430    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:22.203411084 +0000 UTC m=+78.141535395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:18.203972 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:18.203474    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:22.203458238 +0000 UTC m=+78.141582564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:18.423192 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:18.423156    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084dd07c_78d9_4d50_b2c2_13308eec2676.slice/crio-b4a64439bb9ed65cbe43bc19be2f69489d8de97e4c09471cb3bdba8d060427e1 WatchSource:0}: Error finding container b4a64439bb9ed65cbe43bc19be2f69489d8de97e4c09471cb3bdba8d060427e1: Status 404 returned error can't find the container with id b4a64439bb9ed65cbe43bc19be2f69489d8de97e4c09471cb3bdba8d060427e1
Jul 26 15:51:18.566551 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.566508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p7dm4"]
Jul 26 15:51:18.847751 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.847561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8" event={"ID":"67abce95-3575-49e8-a3cf-e77bc3ea6f1b","Type":"ContainerStarted","Data":"e8e49bce818412dd4aa7e1ba3ececc00d6a686a3606d30354c27650ae8f2c7c6"}
Jul 26 15:51:18.849330 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.849299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzrx8" event={"ID":"226f03d2-be7e-413c-9b17-27c95adddbd7","Type":"ContainerStarted","Data":"de98ee9b946d934824233e9318ab9e36273ce7f1d04d305df9dd446e79ad1f89"}
Jul 26 15:51:18.849862 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.849795    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:51:18.852077 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.852054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bfb8-l8xm4" event={"ID":"084dd07c-78d9-4d50-b2c2-13308eec2676","Type":"ContainerStarted","Data":"b4a64439bb9ed65cbe43bc19be2f69489d8de97e4c09471cb3bdba8d060427e1"}
Jul 26 15:51:18.854331 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.854307    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qfqv" event={"ID":"ad2d4624-43e8-4832-a099-d8d88e62aa3b","Type":"ContainerStarted","Data":"f65cca218311804c83054059037b5c10aa67e71f409bf21f59dba4f9f007da93"}
Jul 26 15:51:18.856051 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.856028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj" event={"ID":"6168d221-2589-4df0-a000-3ba5eeeb4234","Type":"ContainerStarted","Data":"2b5803935a2d5dd63a030b3f2d1a18b9694a4cd1eaaed6368a2e53364a8665e3"}
Jul 26 15:51:18.856385 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.856367    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:18.858244 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.858224    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj"
Jul 26 15:51:18.858383 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.858361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5twbk" event={"ID":"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c","Type":"ContainerStarted","Data":"6252d78e0a5640640452ce3e91d0ec44385520943a66b7dd6b4b03c6bb0bc2b8"}
Jul 26 15:51:18.858464 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.858411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5twbk" event={"ID":"b2a0213c-44b0-4ab3-a0c6-0fe3716fd35c","Type":"ContainerStarted","Data":"3c7b44ee261e31e9d371fb156763fcf3d19d65130d8cf619aa9eb658e2a49e59"}
Jul 26 15:51:18.859859 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.859838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7dm4" event={"ID":"d0204351-51f1-45f9-a806-a01d00ab335b","Type":"ContainerStarted","Data":"50aadc1b55fa3dc20b58b20daac8e47ba4f10831fa4c80fae7ef44c58898cee3"}
Jul 26 15:51:18.868110 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.868065    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2dvl8" podStartSLOduration=0.887690433 podStartE2EDuration="9.868050328s" totalImagesPullingTime="8.980359895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:18.868018863 +0000 UTC m=+74.806143191" watchObservedRunningTime="2026-07-26 15:51:18.868050328 +0000 UTC m=+74.806174658"
Jul 26 15:51:18.894304 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.894251    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5twbk" podStartSLOduration=66.903926603 podStartE2EDuration="1m14.894233115s" totalImagesPullingTime="7.990306512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:18.893228554 +0000 UTC m=+74.831352886" watchObservedRunningTime="2026-07-26 15:51:18.894233115 +0000 UTC m=+74.832357447"
Jul 26 15:51:18.919539 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.919483    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4qfqv" podStartSLOduration=66.141858379 podStartE2EDuration="1m13.91946458s" totalImagesPullingTime="7.777606201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:18.90896761 +0000 UTC m=+74.847091937" watchObservedRunningTime="2026-07-26 15:51:18.91946458 +0000 UTC m=+74.857588911"
Jul 26 15:51:18.935857 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:18.935770    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xzrx8" podStartSLOduration=66.935581631 podStartE2EDuration="1m14.935750283s" totalImagesPullingTime="8.000168652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:18.934174558 +0000 UTC m=+74.872298889" watchObservedRunningTime="2026-07-26 15:51:18.935750283 +0000 UTC m=+74.873874614"
Jul 26 15:51:22.099905 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.099852    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79474f6666-92cgj" podStartSLOduration=5.002224878 podStartE2EDuration="14.099833191s" totalImagesPullingTime="9.097608313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:18.950676727 +0000 UTC m=+74.888801059" watchObservedRunningTime="2026-07-26 15:51:22.099833191 +0000 UTC m=+78.037957546"
Jul 26 15:51:22.100665 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.100643    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"]
Jul 26 15:51:22.104209 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.104182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.106386 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.106362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 26 15:51:22.107503 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.107480    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-swcx4\""
Jul 26 15:51:22.107625 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.107504    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 15:51:22.107625 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.107531    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 26 15:51:22.111923 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.111897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"]
Jul 26 15:51:22.140773 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.140739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.140893 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.140783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.140948 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.140889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.140995 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.140966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7kj\" (UniqueName: \"kubernetes.io/projected/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-kube-api-access-8h7kj\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.241494 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.241660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241499    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.241660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.241660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:22.241660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7kj\" (UniqueName: \"kubernetes.io/projected/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-kube-api-access-8h7kj\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.241660 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.241656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241669    2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241743    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241762    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241766    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls podName:a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada nodeName:}" failed. No retries permitted until 2026-07-26 15:51:22.741742206 +0000 UTC m=+78.679866538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls") pod "prometheus-operator-84d69f794d-8ssgd" (UID: "a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada") : secret "prometheus-operator-tls" not found
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:30.241805649 +0000 UTC m=+86.179929967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : configmap "kube-rbac-proxy" not found
Jul 26 15:51:22.241926 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:22.241836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls podName:704ace0b-a257-4b4e-9199-5c62e4c2e19d nodeName:}" failed. No retries permitted until 2026-07-26 15:51:30.241827779 +0000 UTC m=+86.179952087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5c4hg" (UID: "704ace0b-a257-4b4e-9199-5c62e4c2e19d") : secret "insights-runtime-extractor-tls" not found
Jul 26 15:51:22.242344 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.242320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.244149 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.244127    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.257841 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.257814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7kj\" (UniqueName: \"kubernetes.io/projected/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-kube-api-access-8h7kj\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.746021 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.745979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:22.748488 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:22.748463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8ssgd\" (UID: \"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:23.015765 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:23.015671    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"
Jul 26 15:51:25.845665 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:25.845629    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:29.067588 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.067566    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8ssgd"]
Jul 26 15:51:29.069744 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:29.069719    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76e7ecf_2a7c_4deb_bd7a_81ff83cf4ada.slice/crio-c0aebadc06d0b79782d81658326db776bd33a4575ff89b1c2bd62c718a35a400 WatchSource:0}: Error finding container c0aebadc06d0b79782d81658326db776bd33a4575ff89b1c2bd62c718a35a400: Status 404 returned error can't find the container with id c0aebadc06d0b79782d81658326db776bd33a4575ff89b1c2bd62c718a35a400
Jul 26 15:51:29.908855 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.908781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bfb8-l8xm4" event={"ID":"084dd07c-78d9-4d50-b2c2-13308eec2676","Type":"ContainerStarted","Data":"a7a716407e529117a9569d2e951556732bc7c7eda61aee69ce2585397331e71d"}
Jul 26 15:51:29.912957 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.912888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd" event={"ID":"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada","Type":"ContainerStarted","Data":"c0aebadc06d0b79782d81658326db776bd33a4575ff89b1c2bd62c718a35a400"}
Jul 26 15:51:29.917311 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.917280    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7dm4" event={"ID":"d0204351-51f1-45f9-a806-a01d00ab335b","Type":"ContainerStarted","Data":"5ce7acb910802643d2e3311990351041f1740037ebd6bb2c3404ee06b1b3a0fc"}
Jul 26 15:51:29.917438 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.917328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p7dm4" event={"ID":"d0204351-51f1-45f9-a806-a01d00ab335b","Type":"ContainerStarted","Data":"d0090ae98690ec095addb9193e89f4857222474e655b79290ab9425e0304ca37"}
Jul 26 15:51:29.917891 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.917848    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:51:29.920756 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.920528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-szrcf" event={"ID":"840bbf17-b5e3-4b45-8dea-d19912a24860","Type":"ContainerStarted","Data":"0173a384f91032bf6d937140a2692405b4b16df24f172ce2913c6dfce8659002"}
Jul 26 15:51:29.921850 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.921769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:29.929233 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.929213    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-szrcf"
Jul 26 15:51:29.945443 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.945247    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7445bfb8-l8xm4" podStartSLOduration=7.495018163 podStartE2EDuration="17.945230118s" totalImagesPullingTime="10.450211955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:29.92899194 +0000 UTC m=+85.867116271" watchObservedRunningTime="2026-07-26 15:51:29.945230118 +0000 UTC m=+85.883354450"
Jul 26 15:51:29.946084 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.946036    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-szrcf" podStartSLOduration=1.47453771 podStartE2EDuration="20.946022854s" totalImagesPullingTime="19.471485144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:29.944718836 +0000 UTC m=+85.882843166" watchObservedRunningTime="2026-07-26 15:51:29.946022854 +0000 UTC m=+85.884147187"
Jul 26 15:51:29.964822 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:29.964533    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-p7dm4" podStartSLOduration=40.629432951 podStartE2EDuration="50.964513666s" totalImagesPullingTime="10.335080715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:29.963235411 +0000 UTC m=+85.901359742" watchObservedRunningTime="2026-07-26 15:51:29.964513666 +0000 UTC m=+85.902637997"
Jul 26 15:51:30.310347 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.310117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:30.310347 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.310208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:30.310866 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.310818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/704ace0b-a257-4b4e-9199-5c62e4c2e19d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:30.314086 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.314031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/704ace0b-a257-4b4e-9199-5c62e4c2e19d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5c4hg\" (UID: \"704ace0b-a257-4b4e-9199-5c62e4c2e19d\") " pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:30.406547 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.406508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5c4hg"
Jul 26 15:51:30.595080 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.594999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5c4hg"]
Jul 26 15:51:30.725411 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:30.725381    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704ace0b_a257_4b4e_9199_5c62e4c2e19d.slice/crio-4cfb55dafa1904ab31c94bb93d95810aa1ed0180a55f581532938c58826d0c34 WatchSource:0}: Error finding container 4cfb55dafa1904ab31c94bb93d95810aa1ed0180a55f581532938c58826d0c34: Status 404 returned error can't find the container with id 4cfb55dafa1904ab31c94bb93d95810aa1ed0180a55f581532938c58826d0c34
Jul 26 15:51:30.819422 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.819396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f84cf8886-6sjvn"
Jul 26 15:51:30.931955 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.931924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd" event={"ID":"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada","Type":"ContainerStarted","Data":"9f9da7d28e06ab4d99a105309aa0100512a28b1197f06a7a5382f86485c9d69f"}
Jul 26 15:51:30.933135 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:30.933102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5c4hg" event={"ID":"704ace0b-a257-4b4e-9199-5c62e4c2e19d","Type":"ContainerStarted","Data":"4cfb55dafa1904ab31c94bb93d95810aa1ed0180a55f581532938c58826d0c34"}
Jul 26 15:51:31.941296 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:31.941259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd" event={"ID":"a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada","Type":"ContainerStarted","Data":"6504036fcb3ee40022f6bd389db26e9d559a7441e1d256d9438d215ec8392cbc"}
Jul 26 15:51:31.958287 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:31.958237    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-8ssgd" podStartSLOduration=8.287955722 podStartE2EDuration="9.958216425s" totalImagesPullingTime="1.670260703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:31.957292066 +0000 UTC m=+87.895416396" watchObservedRunningTime="2026-07-26 15:51:31.958216425 +0000 UTC m=+87.896340758"
Jul 26 15:51:33.154228 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.154152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:33.522471 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.522430    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"]
Jul 26 15:51:33.575417 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.574842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"]
Jul 26 15:51:33.575417 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.574899    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b9457"]
Jul 26 15:51:33.575656 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.575455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.578389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.577918    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 26 15:51:33.578389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.577996    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g8t9d\""
Jul 26 15:51:33.578389 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.578231    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 26 15:51:33.578999 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.578952    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 26 15:51:33.607450 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.607425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.611134 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.611084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 15:51:33.611487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.611400    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 15:51:33.611808 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.611785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qqbbn\""
Jul 26 15:51:33.611953 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.611848    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 15:51:33.650981 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.650944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.650981 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.650975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7j7k\" (UniqueName: \"kubernetes.io/projected/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-api-access-f7j7k\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.651224 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.651005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.651224 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.651102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.651224 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.651157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.651224 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.651190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.752509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-tls\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.752509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmb4\" (UniqueName: \"kubernetes.io/projected/2a331d4e-cae4-4563-aaa3-8953544443ca-kube-api-access-tkmb4\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-sys\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.752791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-root\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-wtmp\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7j7k\" (UniqueName: \"kubernetes.io/projected/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-api-access-f7j7k\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-metrics-client-ca\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.753146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.752983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-textfile\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.753462 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.753439    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.753736 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.753713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.754501 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:33.754477    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 26 15:51:33.754578 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:51:33.754548    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls podName:bbe27cc5-80dd-4ae4-8b79-62c756aa7907 nodeName:}" failed. No retries permitted until 2026-07-26 15:51:34.254530735 +0000 UTC m=+90.192655047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-7vdxs" (UID: "bbe27cc5-80dd-4ae4-8b79-62c756aa7907") : secret "kube-state-metrics-tls" not found
Jul 26 15:51:33.754811 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.754595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.755751 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.755728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.773100 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.773024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7j7k\" (UniqueName: \"kubernetes.io/projected/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-api-access-f7j7k\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:33.854088 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-metrics-client-ca\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-textfile\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-tls\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmb4\" (UniqueName: \"kubernetes.io/projected/2a331d4e-cae4-4563-aaa3-8953544443ca-kube-api-access-tkmb4\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854257 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-sys\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854553 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-root\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854553 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-wtmp\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854553 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-wtmp\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854553 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-textfile\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854807 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-metrics-client-ca\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854949 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854856    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-sys\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.854949 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.854912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a331d4e-cae4-4563-aaa3-8953544443ca-root\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.855119 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.855012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.857045 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.857018    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-tls\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.859273 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.859230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a331d4e-cae4-4563-aaa3-8953544443ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.863727 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.863672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmb4\" (UniqueName: \"kubernetes.io/projected/2a331d4e-cae4-4563-aaa3-8953544443ca-kube-api-access-tkmb4\") pod \"node-exporter-b9457\" (UID: \"2a331d4e-cae4-4563-aaa3-8953544443ca\") " pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:33.919722 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:33.919520    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b9457"
Jul 26 15:51:34.258755 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:34.258624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:34.261608 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:34.261555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbe27cc5-80dd-4ae4-8b79-62c756aa7907-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-7vdxs\" (UID: \"bbe27cc5-80dd-4ae4-8b79-62c756aa7907\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:34.488498 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:34.488461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"
Jul 26 15:51:36.439432 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.439393    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"]
Jul 26 15:51:36.485323 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.485281    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"]
Jul 26 15:51:36.485492 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.485437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.487746 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.487654    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 26 15:51:36.487746 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.487671    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 26 15:51:36.488487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.488005    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-m8rdsco5l6nc\""
Jul 26 15:51:36.488487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.488203    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8t9gx\""
Jul 26 15:51:36.488487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.488220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 26 15:51:36.488487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.488327    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 26 15:51:36.488487 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.488341    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 26 15:51:36.583198 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583381 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llkk8\" (UniqueName: \"kubernetes.io/projected/b437e5ea-2e67-4a16-86f8-569b8746c571-kube-api-access-llkk8\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583381 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-grpc-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583381 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583599 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583599 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583599 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.583599 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.583487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b437e5ea-2e67-4a16-86f8-569b8746c571-metrics-client-ca\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684475 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-grpc-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684475 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684475 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684475 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684475 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684848 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b437e5ea-2e67-4a16-86f8-569b8746c571-metrics-client-ca\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.684848 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.684837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.686914 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.685271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llkk8\" (UniqueName: \"kubernetes.io/projected/b437e5ea-2e67-4a16-86f8-569b8746c571-kube-api-access-llkk8\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.686914 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.686815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b437e5ea-2e67-4a16-86f8-569b8746c571-metrics-client-ca\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.688337 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.688309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.690081 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.689491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.690081 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.689494    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.690081 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.689767    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.690081 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.690008    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-grpc-tls\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.691520 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.691478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b437e5ea-2e67-4a16-86f8-569b8746c571-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.693454 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.693430    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llkk8\" (UniqueName: \"kubernetes.io/projected/b437e5ea-2e67-4a16-86f8-569b8746c571-kube-api-access-llkk8\") pod \"thanos-querier-6b8cfd54c5-cnfv6\" (UID: \"b437e5ea-2e67-4a16-86f8-569b8746c571\") " pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:36.800671 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:36.800638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:37.277242 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:37.277200    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a331d4e_cae4_4563_aaa3_8953544443ca.slice/crio-44320f8986390493eae8f96fe45691a8ba71be92856e44c4a7c5798de1dc8218 WatchSource:0}: Error finding container 44320f8986390493eae8f96fe45691a8ba71be92856e44c4a7c5798de1dc8218: Status 404 returned error can't find the container with id 44320f8986390493eae8f96fe45691a8ba71be92856e44c4a7c5798de1dc8218
Jul 26 15:51:37.442381 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.442344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs"]
Jul 26 15:51:37.447290 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:37.447251    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbe27cc5_80dd_4ae4_8b79_62c756aa7907.slice/crio-50e1af9da80617e1c8124d99fac66c3b6b40478be94fc5ad615eff617a17f3d8 WatchSource:0}: Error finding container 50e1af9da80617e1c8124d99fac66c3b6b40478be94fc5ad615eff617a17f3d8: Status 404 returned error can't find the container with id 50e1af9da80617e1c8124d99fac66c3b6b40478be94fc5ad615eff617a17f3d8
Jul 26 15:51:37.461277 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.461254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"]
Jul 26 15:51:37.630353 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:37.630279    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb437e5ea_2e67_4a16_86f8_569b8746c571.slice/crio-66c87234e3d338028b14fdb7b0eeec3601f43b04d3074dfbd539f265b80f7457 WatchSource:0}: Error finding container 66c87234e3d338028b14fdb7b0eeec3601f43b04d3074dfbd539f265b80f7457: Status 404 returned error can't find the container with id 66c87234e3d338028b14fdb7b0eeec3601f43b04d3074dfbd539f265b80f7457
Jul 26 15:51:37.971110 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.970940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"66c87234e3d338028b14fdb7b0eeec3601f43b04d3074dfbd539f265b80f7457"}
Jul 26 15:51:37.973256 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.973188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs" event={"ID":"bbe27cc5-80dd-4ae4-8b79-62c756aa7907","Type":"ContainerStarted","Data":"50e1af9da80617e1c8124d99fac66c3b6b40478be94fc5ad615eff617a17f3d8"}
Jul 26 15:51:37.974874 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.974844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5c4hg" event={"ID":"704ace0b-a257-4b4e-9199-5c62e4c2e19d","Type":"ContainerStarted","Data":"c2d62e9e1082b414e6ec3fad516d771653708a7c97cb05256019578b21d8b329"}
Jul 26 15:51:37.976809 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:37.976783    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9457" event={"ID":"2a331d4e-cae4-4563-aaa3-8953544443ca","Type":"ContainerStarted","Data":"44320f8986390493eae8f96fe45691a8ba71be92856e44c4a7c5798de1dc8218"}
Jul 26 15:51:38.672066 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.672033    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fdf556688-7ggj7"]
Jul 26 15:51:38.687309 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.687281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.691137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.690950    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 26 15:51:38.691137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.690992    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 26 15:51:38.691137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.690993    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 26 15:51:38.691137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.690993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lghwf\""
Jul 26 15:51:38.691137 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.691062    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 26 15:51:38.691632 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.691610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 26 15:51:38.700502 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.700482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fdf556688-7ggj7"]
Jul 26 15:51:38.701010 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.700987    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 26 15:51:38.808414 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-metrics-client-ca\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808592 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxj8g\" (UniqueName: \"kubernetes.io/projected/9d6c10e4-0894-4f60-8192-2d5666ae8c89-kube-api-access-pxj8g\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808592 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-federate-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808592 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808500    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-serving-certs-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808592 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808824 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808824 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.808824 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.808749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910052 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxj8g\" (UniqueName: \"kubernetes.io/projected/9d6c10e4-0894-4f60-8192-2d5666ae8c89-kube-api-access-pxj8g\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910220 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-federate-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910220 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-serving-certs-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910220 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910220 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910220 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910467 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910467 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-metrics-client-ca\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.910984 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.910954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-serving-certs-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.911363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.911101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-metrics-client-ca\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.911741 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.911717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.913390 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.913341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.913390 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.913370    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-telemeter-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.913806 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.913782    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-federate-client-tls\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.913951 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.913934    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d6c10e4-0894-4f60-8192-2d5666ae8c89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.918302 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.918283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxj8g\" (UniqueName: \"kubernetes.io/projected/9d6c10e4-0894-4f60-8192-2d5666ae8c89-kube-api-access-pxj8g\") pod \"telemeter-client-6fdf556688-7ggj7\" (UID: \"9d6c10e4-0894-4f60-8192-2d5666ae8c89\") " pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:38.997529 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:38.997501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7"
Jul 26 15:51:40.594048 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:40.593933    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fdf556688-7ggj7"]
Jul 26 15:51:40.595723 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:51:40.595680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d6c10e4_0894_4f60_8192_2d5666ae8c89.slice/crio-94238b40c1fb2d409e5e7edef048515b3a0d2ea39fa2a5f4ff694979be2f5916 WatchSource:0}: Error finding container 94238b40c1fb2d409e5e7edef048515b3a0d2ea39fa2a5f4ff694979be2f5916: Status 404 returned error can't find the container with id 94238b40c1fb2d409e5e7edef048515b3a0d2ea39fa2a5f4ff694979be2f5916
Jul 26 15:51:40.945052 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:40.944288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p7dm4"
Jul 26 15:51:40.996002 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:40.995894    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"bf44c8a9a3d36749bc4b9df4306eb80e9954d984ca9a36f7cfe9ee65db17b400"}
Jul 26 15:51:40.998617 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:40.998498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs" event={"ID":"bbe27cc5-80dd-4ae4-8b79-62c756aa7907","Type":"ContainerStarted","Data":"297d3b8e0695758a08f30267ffc08b5ce4ea9ed37315e9a89a274b4d91ae2659"}
Jul 26 15:51:40.998617 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:40.998555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs" event={"ID":"bbe27cc5-80dd-4ae4-8b79-62c756aa7907","Type":"ContainerStarted","Data":"8d9d6cbd8445944c386e7da3e45f23fb4c772b34fbeb177fc35af5f82b0a5cb9"}
Jul 26 15:51:41.001028 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:41.001000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7" event={"ID":"9d6c10e4-0894-4f60-8192-2d5666ae8c89","Type":"ContainerStarted","Data":"94238b40c1fb2d409e5e7edef048515b3a0d2ea39fa2a5f4ff694979be2f5916"}
Jul 26 15:51:41.007609 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:41.006866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9457" event={"ID":"2a331d4e-cae4-4563-aaa3-8953544443ca","Type":"ContainerStarted","Data":"12c1c51746e602199f4e2d2f7b5d88383387c2262795329a0a94d1ab56461de5"}
Jul 26 15:51:43.020463 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:43.020429    2576 generic.go:356] "Generic (PLEG): container finished" podID="2a331d4e-cae4-4563-aaa3-8953544443ca" containerID="12c1c51746e602199f4e2d2f7b5d88383387c2262795329a0a94d1ab56461de5" exitCode=0
Jul 26 15:51:43.020879 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:43.020486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9457" event={"ID":"2a331d4e-cae4-4563-aaa3-8953544443ca","Type":"ContainerDied","Data":"12c1c51746e602199f4e2d2f7b5d88383387c2262795329a0a94d1ab56461de5"}
Jul 26 15:51:44.028253 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.028180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"1850b6d436fa5f1925d2e55f91c101f8d99bc9c250bb51d496883e495810c757"}
Jul 26 15:51:44.028253 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.028245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"9cc6bba60b10c0fa05cd0782373c22b090e481d9149395f66c8ac5ad418bf36b"}
Jul 26 15:51:44.030890 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.030853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs" event={"ID":"bbe27cc5-80dd-4ae4-8b79-62c756aa7907","Type":"ContainerStarted","Data":"9e2fa356deea2bfa007b39b79b83b444b29d654bbb26db36de2dc0b58365ba9f"}
Jul 26 15:51:44.033183 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.033121    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5c4hg" event={"ID":"704ace0b-a257-4b4e-9199-5c62e4c2e19d","Type":"ContainerStarted","Data":"d6a83abf387faebca95cc7576d897af7913b49c84cfe89623358ec4f7b8bc8ad"}
Jul 26 15:51:44.035547 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.035524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9457" event={"ID":"2a331d4e-cae4-4563-aaa3-8953544443ca","Type":"ContainerStarted","Data":"7d6dc210f5526f6b5182ecbb2de7d909effe6642520ddf30edd179970fa85849"}
Jul 26 15:51:44.035652 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.035570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b9457" event={"ID":"2a331d4e-cae4-4563-aaa3-8953544443ca","Type":"ContainerStarted","Data":"eba95e45a99699bdab89ab5631ece0289a58d4b3b9aa64714343a2f95539a8ee"}
Jul 26 15:51:44.056112 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.056070    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-7vdxs" podStartSLOduration=8.07997707 podStartE2EDuration="11.056056446s" totalImagesPullingTime="2.976079376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:44.054241908 +0000 UTC m=+99.992366260" watchObservedRunningTime="2026-07-26 15:51:44.056056446 +0000 UTC m=+99.994180775"
Jul 26 15:51:44.074549 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:44.074046    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b9457" podStartSLOduration=7.83256686 podStartE2EDuration="11.074028283s" totalImagesPullingTime="3.088622272s" totalInitContainerRuntime="152.839151ms" isStatefulPod=true podCreationTimestamp="2026-07-26 15:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:44.072597922 +0000 UTC m=+100.010722251" watchObservedRunningTime="2026-07-26 15:51:44.074028283 +0000 UTC m=+100.012152627"
Jul 26 15:51:45.043818 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:45.043777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7" event={"ID":"9d6c10e4-0894-4f60-8192-2d5666ae8c89","Type":"ContainerStarted","Data":"a75a339d8d184fc9abee9891b8e03186323a4be4e6272664ddbab25130b8a913"}
Jul 26 15:51:46.056369 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:46.056333    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"3ac131d40d794c24d7c6efefee84bfa4dc4d88e37e2a47576e2dc9af198d834a"}
Jul 26 15:51:46.056834 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:46.056449    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"b5be305122b5dc992263a64174adbfbf5c358c3fdfea9fd191a931002d83c99b"}
Jul 26 15:51:46.056834 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:46.056500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" event={"ID":"b437e5ea-2e67-4a16-86f8-569b8746c571","Type":"ContainerStarted","Data":"36d3d2e22f9126c9a8347404a32695e379674d226c4e5bc91f1362777e90fd51"}
Jul 26 15:51:46.056834 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:46.056650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:46.078516 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:46.078083    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6" podStartSLOduration=5.619734988 podStartE2EDuration="10.078062064s" totalImagesPullingTime="4.458327076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:46.075439569 +0000 UTC m=+102.013563913" watchObservedRunningTime="2026-07-26 15:51:46.078062064 +0000 UTC m=+102.016186394"
Jul 26 15:51:49.073731 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:49.073672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5c4hg" event={"ID":"704ace0b-a257-4b4e-9199-5c62e4c2e19d","Type":"ContainerStarted","Data":"2f436ef800e4566866d5aac32f2f40fa92edd69f2c5df48a3bb91e30b044aacc"}
Jul 26 15:51:49.075676 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:49.075650    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7" event={"ID":"9d6c10e4-0894-4f60-8192-2d5666ae8c89","Type":"ContainerStarted","Data":"5473a2c0ca523b1b790643797fa1c47ddf39414f403a007fd591692afcf0f171"}
Jul 26 15:51:49.075797 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:49.075720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7" event={"ID":"9d6c10e4-0894-4f60-8192-2d5666ae8c89","Type":"ContainerStarted","Data":"91573592a4bef3b78be8c29e49f14768254dacf5918cf5bc2643fd0afff88104"}
Jul 26 15:51:49.096042 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:49.095989    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5c4hg" podStartSLOduration=17.461553165 podStartE2EDuration="35.095974957s" totalImagesPullingTime="17.634421792s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 15:51:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:49.094712408 +0000 UTC m=+105.032836734" watchObservedRunningTime="2026-07-26 15:51:49.095974957 +0000 UTC m=+105.034099287"
Jul 26 15:51:49.117236 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:49.117195    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fdf556688-7ggj7" podStartSLOduration=3.661588514 podStartE2EDuration="11.117183358s" totalImagesPullingTime="7.455594844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:51:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:51:49.115429587 +0000 UTC m=+105.053553918" watchObservedRunningTime="2026-07-26 15:51:49.117183358 +0000 UTC m=+105.055307687"
Jul 26 15:51:50.871168 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:50.871137    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xzrx8"
Jul 26 15:51:52.066048 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:52.066020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b8cfd54c5-cnfv6"
Jul 26 15:51:54.932146 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:54.932100    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7445bfb8-l8xm4" podUID="084dd07c-78d9-4d50-b2c2-13308eec2676" containerName="console" containerID="cri-o://a7a716407e529117a9569d2e951556732bc7c7eda61aee69ce2585397331e71d" gracePeriod=15
Jul 26 15:51:55.098951 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.098921    2576 generic.go:356] "Generic (PLEG): container finished" podID="084dd07c-78d9-4d50-b2c2-13308eec2676" containerID="a7a716407e529117a9569d2e951556732bc7c7eda61aee69ce2585397331e71d" exitCode=0
Jul 26 15:51:55.099125 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.098964    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bfb8-l8xm4" event={"ID":"084dd07c-78d9-4d50-b2c2-13308eec2676","Type":"ContainerDied","Data":"a7a716407e529117a9569d2e951556732bc7c7eda61aee69ce2585397331e71d"}
Jul 26 15:51:55.198995 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.198944    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:55.257479 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257455    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bftht\" (UniqueName: \"kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257608 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257608 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257608 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257536    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257608 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257601    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257811 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257638    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert\") pod \"084dd07c-78d9-4d50-b2c2-13308eec2676\" (UID: \"084dd07c-78d9-4d50-b2c2-13308eec2676\") "
Jul 26 15:51:55.257954 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257927    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca" (OuterVolumeSpecName: "service-ca") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:55.258066 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:55.258066 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.257994    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config" (OuterVolumeSpecName: "console-config") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 15:51:55.259830 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.259803    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:55.259938 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.259839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht" (OuterVolumeSpecName: "kube-api-access-bftht") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "kube-api-access-bftht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:51:55.260001 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.259969    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "084dd07c-78d9-4d50-b2c2-13308eec2676" (UID: "084dd07c-78d9-4d50-b2c2-13308eec2676"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 15:51:55.359073 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359043    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bftht\" (UniqueName: \"kubernetes.io/projected/084dd07c-78d9-4d50-b2c2-13308eec2676-kube-api-access-bftht\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:55.359073 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359068    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-oauth-serving-cert\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:55.359073 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359078    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-service-ca\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:55.359266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359087    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-oauth-config\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:55.359266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359095    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/084dd07c-78d9-4d50-b2c2-13308eec2676-console-config\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:55.359266 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:55.359104    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/084dd07c-78d9-4d50-b2c2-13308eec2676-console-serving-cert\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:51:56.105677 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.104727    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7445bfb8-l8xm4" event={"ID":"084dd07c-78d9-4d50-b2c2-13308eec2676","Type":"ContainerDied","Data":"b4a64439bb9ed65cbe43bc19be2f69489d8de97e4c09471cb3bdba8d060427e1"}
Jul 26 15:51:56.105677 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.105023    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7445bfb8-l8xm4"
Jul 26 15:51:56.106701 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.105091    2576 scope.go:117] "RemoveContainer" containerID="a7a716407e529117a9569d2e951556732bc7c7eda61aee69ce2585397331e71d"
Jul 26 15:51:56.126648 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.126626    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:56.130114 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.130094    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7445bfb8-l8xm4"]
Jul 26 15:51:56.558924 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:51:56.558889    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084dd07c-78d9-4d50-b2c2-13308eec2676" path="/var/lib/kubelet/pods/084dd07c-78d9-4d50-b2c2-13308eec2676/volumes"
Jul 26 15:54:21.750310 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.750265    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"]
Jul 26 15:54:21.750825 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.750569    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084dd07c-78d9-4d50-b2c2-13308eec2676" containerName="console"
Jul 26 15:54:21.750825 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.750599    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="084dd07c-78d9-4d50-b2c2-13308eec2676" containerName="console"
Jul 26 15:54:21.750825 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.750682    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="084dd07c-78d9-4d50-b2c2-13308eec2676" containerName="console"
Jul 26 15:54:21.753359 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.753344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.756488 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.756032    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:54:21.756488 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.756151    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jbfqb\""
Jul 26 15:54:21.756488 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.756265    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 26 15:54:21.766806 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.766784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"]
Jul 26 15:54:21.793773 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.793749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62512095-090f-40bf-b483-bd1d4cc77759-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.793892 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.793798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxnnr\" (UniqueName: \"kubernetes.io/projected/62512095-090f-40bf-b483-bd1d4cc77759-kube-api-access-jxnnr\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.894794 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.894763    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62512095-090f-40bf-b483-bd1d4cc77759-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.894895 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.894819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxnnr\" (UniqueName: \"kubernetes.io/projected/62512095-090f-40bf-b483-bd1d4cc77759-kube-api-access-jxnnr\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.895121 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.895103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62512095-090f-40bf-b483-bd1d4cc77759-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:21.911069 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:21.911045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxnnr\" (UniqueName: \"kubernetes.io/projected/62512095-090f-40bf-b483-bd1d4cc77759-kube-api-access-jxnnr\") pod \"cert-manager-operator-controller-manager-55c444bf86-9twtk\" (UID: \"62512095-090f-40bf-b483-bd1d4cc77759\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:22.067718 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:22.067632    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"
Jul 26 15:54:22.232031 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:22.232004    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk"]
Jul 26 15:54:22.234867 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:54:22.234840    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62512095_090f_40bf_b483_bd1d4cc77759.slice/crio-cd251582e4f0a4158de73952ffb5331247bd652bb2142798a04077940d3b0332 WatchSource:0}: Error finding container cd251582e4f0a4158de73952ffb5331247bd652bb2142798a04077940d3b0332: Status 404 returned error can't find the container with id cd251582e4f0a4158de73952ffb5331247bd652bb2142798a04077940d3b0332
Jul 26 15:54:22.616044 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:22.616009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk" event={"ID":"62512095-090f-40bf-b483-bd1d4cc77759","Type":"ContainerStarted","Data":"cd251582e4f0a4158de73952ffb5331247bd652bb2142798a04077940d3b0332"}
Jul 26 15:54:25.632171 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:25.632127    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk" event={"ID":"62512095-090f-40bf-b483-bd1d4cc77759","Type":"ContainerStarted","Data":"c23f7d13838b9a1d34436622cb620e91f10bde6e593f467c279fc4e03ef63cb8"}
Jul 26 15:54:25.652950 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:25.652897    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9twtk" podStartSLOduration=1.766980306 podStartE2EDuration="4.652881066s" totalImagesPullingTime="2.88590076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:25.652385639 +0000 UTC m=+261.590509970" watchObservedRunningTime="2026-07-26 15:54:25.652881066 +0000 UTC m=+261.591005396"
Jul 26 15:54:40.539253 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.539220    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"]
Jul 26 15:54:40.542471 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.542455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.544515 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.544488    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 26 15:54:40.544658 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.544491    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 26 15:54:40.544727 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.544676    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7lstn\""
Jul 26 15:54:40.549804 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.549783    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"]
Jul 26 15:54:40.645538 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.645507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a9315e-8e46-457a-a097-b4d0a9f283ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.645538 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.645540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzmg\" (UniqueName: \"kubernetes.io/projected/81a9315e-8e46-457a-a097-b4d0a9f283ca-kube-api-access-jzzmg\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.746636 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.746590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a9315e-8e46-457a-a097-b4d0a9f283ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.746636 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.746634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzmg\" (UniqueName: \"kubernetes.io/projected/81a9315e-8e46-457a-a097-b4d0a9f283ca-kube-api-access-jzzmg\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.747107 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.747062    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81a9315e-8e46-457a-a097-b4d0a9f283ca-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.755785 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.755756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzmg\" (UniqueName: \"kubernetes.io/projected/81a9315e-8e46-457a-a097-b4d0a9f283ca-kube-api-access-jzzmg\") pod \"openshift-lws-operator-fd8ccff4c-dpl5j\" (UID: \"81a9315e-8e46-457a-a097-b4d0a9f283ca\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.865332 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.865255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"
Jul 26 15:54:40.996656 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:40.995809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j"]
Jul 26 15:54:41.000316 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:54:41.000286    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81a9315e_8e46_457a_a097_b4d0a9f283ca.slice/crio-57c2f111a6d1dce51a0a495bab301d884c40118418fdbd5c8b7e15dfee598457 WatchSource:0}: Error finding container 57c2f111a6d1dce51a0a495bab301d884c40118418fdbd5c8b7e15dfee598457: Status 404 returned error can't find the container with id 57c2f111a6d1dce51a0a495bab301d884c40118418fdbd5c8b7e15dfee598457
Jul 26 15:54:41.694010 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:41.693979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j" event={"ID":"81a9315e-8e46-457a-a097-b4d0a9f283ca","Type":"ContainerStarted","Data":"57c2f111a6d1dce51a0a495bab301d884c40118418fdbd5c8b7e15dfee598457"}
Jul 26 15:54:44.709460 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:44.709423    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j" event={"ID":"81a9315e-8e46-457a-a097-b4d0a9f283ca","Type":"ContainerStarted","Data":"a19a2cabd3da6bf65f7d2086971887a6f62d9eb471ddd807189dd3030c9700db"}
Jul 26 15:54:44.724518 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:54:44.724470    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dpl5j" podStartSLOduration=1.9594220409999998 podStartE2EDuration="4.724453421s" totalImagesPullingTime="2.76503138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:54:44.722996399 +0000 UTC m=+280.661120733" watchObservedRunningTime="2026-07-26 15:54:44.724453421 +0000 UTC m=+280.662577753"
Jul 26 15:55:01.122970 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.122938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"]
Jul 26 15:55:01.132127 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.132079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.135113 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.135089    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n4l27\""
Jul 26 15:55:01.135244 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.135213    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 15:55:01.135244 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.135226    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 15:55:01.135354 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.135308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 15:55:01.135568 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.135547    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 15:55:01.140447 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.140426    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"]
Jul 26 15:55:01.308511 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.308476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.308511 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.308512    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.308714 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.308535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbkpp\" (UniqueName: \"kubernetes.io/projected/33b57c1e-ac6c-4712-81b3-142c51e32c10-kube-api-access-bbkpp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.308714 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.308601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.308791 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.308710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409459 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409459 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409459 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409734 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbkpp\" (UniqueName: \"kubernetes.io/projected/33b57c1e-ac6c-4712-81b3-142c51e32c10-kube-api-access-bbkpp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409734 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.409905 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.409881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-manifests\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.411785 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.411762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33b57c1e-ac6c-4712-81b3-142c51e32c10-tmp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.411930 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.411914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-apiservice-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.412072 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.412052    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33b57c1e-ac6c-4712-81b3-142c51e32c10-webhook-cert\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.416910 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.416892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbkpp\" (UniqueName: \"kubernetes.io/projected/33b57c1e-ac6c-4712-81b3-142c51e32c10-kube-api-access-bbkpp\") pod \"opendatahub-operator-controller-manager-745bd4f5cc-zhtsx\" (UID: \"33b57c1e-ac6c-4712-81b3-142c51e32c10\") " pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.443733 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.443703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:01.571010 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.570976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"]
Jul 26 15:55:01.574187 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:55:01.574164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b57c1e_ac6c_4712_81b3_142c51e32c10.slice/crio-723d67dd4d93bc91476ce48955d707e8c2342d0c81920ed6302297144e462699 WatchSource:0}: Error finding container 723d67dd4d93bc91476ce48955d707e8c2342d0c81920ed6302297144e462699: Status 404 returned error can't find the container with id 723d67dd4d93bc91476ce48955d707e8c2342d0c81920ed6302297144e462699
Jul 26 15:55:01.778293 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:01.778221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx" event={"ID":"33b57c1e-ac6c-4712-81b3-142c51e32c10","Type":"ContainerStarted","Data":"723d67dd4d93bc91476ce48955d707e8c2342d0c81920ed6302297144e462699"}
Jul 26 15:55:04.901414 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:04.901391    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 15:55:05.798208 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:05.798168    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx" event={"ID":"33b57c1e-ac6c-4712-81b3-142c51e32c10","Type":"ContainerStarted","Data":"c364f8cda0f0fe7d27417630b3e4fa3d8d6bca46fec12927787db9b4441cd858"}
Jul 26 15:55:06.804668 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:06.804627    2576 generic.go:356] "Generic (PLEG): container finished" podID="33b57c1e-ac6c-4712-81b3-142c51e32c10" containerID="c364f8cda0f0fe7d27417630b3e4fa3d8d6bca46fec12927787db9b4441cd858" exitCode=0
Jul 26 15:55:06.805097 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:06.804668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx" event={"ID":"33b57c1e-ac6c-4712-81b3-142c51e32c10","Type":"ContainerDied","Data":"c364f8cda0f0fe7d27417630b3e4fa3d8d6bca46fec12927787db9b4441cd858"}
Jul 26 15:55:06.805195 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:06.805179    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 15:55:07.811627 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:07.811593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx" event={"ID":"33b57c1e-ac6c-4712-81b3-142c51e32c10","Type":"ContainerStarted","Data":"145084313d904373b704c1b40304cbfb0ad6340cd40278aba7555d9d036acb8b"}
Jul 26 15:55:07.812086 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:07.811729    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:07.833144 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:07.833094    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx" podStartSLOduration=2.087230933 podStartE2EDuration="6.833077696s" totalImagesPullingTime="3.696435742s" totalInitContainerRuntime="1.049411021s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:07.83207337 +0000 UTC m=+303.770197712" watchObservedRunningTime="2026-07-26 15:55:07.833077696 +0000 UTC m=+303.771202027"
Jul 26 15:55:18.822347 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:18.822313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-745bd4f5cc-zhtsx"
Jul 26 15:55:19.862101 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.862070    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"]
Jul 26 15:55:19.868417 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.868390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:19.870932 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.870901    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 26 15:55:19.871741 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.871720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 26 15:55:19.871833 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.871754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2czlr\""
Jul 26 15:55:19.873328 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.873308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 26 15:55:19.882393 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.882371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"]
Jul 26 15:55:19.951509 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.951481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757f0d94-b222-4a2a-ac7b-9bbdff481c91-manager-config\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:19.951636 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.951524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:19.951636 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.951545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbhz\" (UniqueName: \"kubernetes.io/projected/757f0d94-b222-4a2a-ac7b-9bbdff481c91-kube-api-access-mnbhz\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:19.951733 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:19.951656    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.052604 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.052571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757f0d94-b222-4a2a-ac7b-9bbdff481c91-manager-config\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.052764 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.052614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.052764 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.052635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbhz\" (UniqueName: \"kubernetes.io/projected/757f0d94-b222-4a2a-ac7b-9bbdff481c91-kube-api-access-mnbhz\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.052764 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.052672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.053343 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.053321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/757f0d94-b222-4a2a-ac7b-9bbdff481c91-manager-config\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.055148 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.055123    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.055254 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.055198    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/757f0d94-b222-4a2a-ac7b-9bbdff481c91-metrics-cert\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.062374 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.062348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbhz\" (UniqueName: \"kubernetes.io/projected/757f0d94-b222-4a2a-ac7b-9bbdff481c91-kube-api-access-mnbhz\") pod \"lws-controller-manager-868c8c7ff4-b7fg8\" (UID: \"757f0d94-b222-4a2a-ac7b-9bbdff481c91\") " pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.178113 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.178036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:20.324682 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.324650    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"]
Jul 26 15:55:20.327644 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:55:20.327618    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757f0d94_b222_4a2a_ac7b_9bbdff481c91.slice/crio-3e9bc7658e7e6a0a71afd96ddb57d7e8232c113bcbabd3817e55005bf8bb5ce4 WatchSource:0}: Error finding container 3e9bc7658e7e6a0a71afd96ddb57d7e8232c113bcbabd3817e55005bf8bb5ce4: Status 404 returned error can't find the container with id 3e9bc7658e7e6a0a71afd96ddb57d7e8232c113bcbabd3817e55005bf8bb5ce4
Jul 26 15:55:20.871261 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:20.871228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8" event={"ID":"757f0d94-b222-4a2a-ac7b-9bbdff481c91","Type":"ContainerStarted","Data":"3e9bc7658e7e6a0a71afd96ddb57d7e8232c113bcbabd3817e55005bf8bb5ce4"}
Jul 26 15:55:22.880887 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:22.880849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8" event={"ID":"757f0d94-b222-4a2a-ac7b-9bbdff481c91","Type":"ContainerStarted","Data":"5eefdd4679d392a4d9bf0e45f60fadf2444ca69ab71d212568ececa6232518d8"}
Jul 26 15:55:22.881306 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:22.880993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:22.899189 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:22.899146    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8" podStartSLOduration=1.777036997 podStartE2EDuration="3.899128991s" totalImagesPullingTime="2.122091994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:22.897283699 +0000 UTC m=+318.835408023" watchObservedRunningTime="2026-07-26 15:55:22.899128991 +0000 UTC m=+318.837253316"
Jul 26 15:55:31.284520 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.284487    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"]
Jul 26 15:55:31.287412 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.287389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.289553 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.289532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cgfpv\""
Jul 26 15:55:31.289637 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.289536    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 26 15:55:31.289637 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.289570    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 26 15:55:31.296727 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.296702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"]
Jul 26 15:55:31.343681 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.343653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjqm\" (UniqueName: \"kubernetes.io/projected/67653c7a-e556-4af4-8186-0eb52dbba186-kube-api-access-kzjqm\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.343681 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.343705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67653c7a-e556-4af4-8186-0eb52dbba186-tmp\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.343883 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.343808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67653c7a-e556-4af4-8186-0eb52dbba186-tls-certs\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.444473 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.444443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67653c7a-e556-4af4-8186-0eb52dbba186-tls-certs\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.444629 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.444515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjqm\" (UniqueName: \"kubernetes.io/projected/67653c7a-e556-4af4-8186-0eb52dbba186-kube-api-access-kzjqm\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.444629 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.444548    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67653c7a-e556-4af4-8186-0eb52dbba186-tmp\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.446751 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.446731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67653c7a-e556-4af4-8186-0eb52dbba186-tmp\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.446905 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.446888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67653c7a-e556-4af4-8186-0eb52dbba186-tls-certs\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.458874 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.458855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjqm\" (UniqueName: \"kubernetes.io/projected/67653c7a-e556-4af4-8186-0eb52dbba186-kube-api-access-kzjqm\") pod \"kube-auth-proxy-5bfd866646-gn54l\" (UID: \"67653c7a-e556-4af4-8186-0eb52dbba186\") " pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.598424 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.598358    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"
Jul 26 15:55:31.746818 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.746784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bfd866646-gn54l"]
Jul 26 15:55:31.751343 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:55:31.751305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67653c7a_e556_4af4_8186_0eb52dbba186.slice/crio-a917278988a3d748e7495c32ab7ef2841ce189e657da30c852094ddf609e08e3 WatchSource:0}: Error finding container a917278988a3d748e7495c32ab7ef2841ce189e657da30c852094ddf609e08e3: Status 404 returned error can't find the container with id a917278988a3d748e7495c32ab7ef2841ce189e657da30c852094ddf609e08e3
Jul 26 15:55:31.921089 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:31.920999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l" event={"ID":"67653c7a-e556-4af4-8186-0eb52dbba186","Type":"ContainerStarted","Data":"a917278988a3d748e7495c32ab7ef2841ce189e657da30c852094ddf609e08e3"}
Jul 26 15:55:33.888437 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:33.888340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-868c8c7ff4-b7fg8"
Jul 26 15:55:34.936013 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:34.935979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l" event={"ID":"67653c7a-e556-4af4-8186-0eb52dbba186","Type":"ContainerStarted","Data":"81eeeab067a3aad38a495840ea5ef33c2421a0c1ccf705583b6e05732bd38822"}
Jul 26 15:55:34.951638 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:55:34.951587    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bfd866646-gn54l" podStartSLOduration=1.348425609 podStartE2EDuration="3.951572454s" totalImagesPullingTime="2.603146845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:55:34.950521876 +0000 UTC m=+330.888646205" watchObservedRunningTime="2026-07-26 15:55:34.951572454 +0000 UTC m=+330.889696825"
Jul 26 15:57:10.020683 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.020650    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"]
Jul 26 15:57:10.023977 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.023958    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.026320 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.026295    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfkp9\""
Jul 26 15:57:10.026424 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.026327    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 26 15:57:10.026424 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.026376    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 26 15:57:10.026517 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.026442    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 26 15:57:10.026517 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.026458    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 26 15:57:10.033573 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.033555    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"]
Jul 26 15:57:10.127394 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.127365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rwtl\" (UniqueName: \"kubernetes.io/projected/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-kube-api-access-4rwtl\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.127557 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.127402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.127557 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.127439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.228041 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.228010    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.228185 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.228070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rwtl\" (UniqueName: \"kubernetes.io/projected/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-kube-api-access-4rwtl\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.228185 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.228091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.228906 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.228884    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.230489 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.230468    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.236701 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.236666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rwtl\" (UniqueName: \"kubernetes.io/projected/3bf8bfba-9cc5-4006-a32e-8142834c3fe9-kube-api-access-4rwtl\") pod \"kuadrant-console-plugin-66b5774985-jtk9f\" (UID: \"3bf8bfba-9cc5-4006-a32e-8142834c3fe9\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.333312 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.333245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"
Jul 26 15:57:10.463109 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:10.463082    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f"]
Jul 26 15:57:10.465645 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:57:10.465612    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3bf8bfba_9cc5_4006_a32e_8142834c3fe9.slice/crio-7361be4a9a1aac108609527200b73b3b68f166ce99ea319c5da261c63aab4067 WatchSource:0}: Error finding container 7361be4a9a1aac108609527200b73b3b68f166ce99ea319c5da261c63aab4067: Status 404 returned error can't find the container with id 7361be4a9a1aac108609527200b73b3b68f166ce99ea319c5da261c63aab4067
Jul 26 15:57:11.325445 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:11.325408    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f" event={"ID":"3bf8bfba-9cc5-4006-a32e-8142834c3fe9","Type":"ContainerStarted","Data":"7361be4a9a1aac108609527200b73b3b68f166ce99ea319c5da261c63aab4067"}
Jul 26 15:57:31.425844 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:31.425806    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f" event={"ID":"3bf8bfba-9cc5-4006-a32e-8142834c3fe9","Type":"ContainerStarted","Data":"9c1cad633812bc6c3de336b671b768b745f75aa4d8b7b7affa9277e812e5ba95"}
Jul 26 15:57:31.441035 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:57:31.440980    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-jtk9f" podStartSLOduration=0.963558413 podStartE2EDuration="21.440961726s" totalImagesPullingTime="20.477403313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:57:31.43988752 +0000 UTC m=+447.378011857" watchObservedRunningTime="2026-07-26 15:57:31.440961726 +0000 UTC m=+447.379086060"
Jul 26 15:58:03.851595 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.851562    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:58:03.870183 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.870158    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:58:03.870356 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.870243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:03.872373 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.872349    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 26 15:58:03.880022 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.880000    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:58:03.996072 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.996045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjrj\" (UniqueName: \"kubernetes.io/projected/7ea0162f-cfec-4e24-89a0-3949fae01d03-kube-api-access-frjrj\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:03.996241 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:03.996101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea0162f-cfec-4e24-89a0-3949fae01d03-config-file\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.097438 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.097408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjrj\" (UniqueName: \"kubernetes.io/projected/7ea0162f-cfec-4e24-89a0-3949fae01d03-kube-api-access-frjrj\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.097598 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.097452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea0162f-cfec-4e24-89a0-3949fae01d03-config-file\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.098019 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.098000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ea0162f-cfec-4e24-89a0-3949fae01d03-config-file\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.106473 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.106422    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjrj\" (UniqueName: \"kubernetes.io/projected/7ea0162f-cfec-4e24-89a0-3949fae01d03-kube-api-access-frjrj\") pod \"limitador-limitador-54d6d988d5-wqr6b\" (UID: \"7ea0162f-cfec-4e24-89a0-3949fae01d03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.180427 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.180401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:04.304261 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.304206    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:58:04.307101 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:58:04.307075    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea0162f_cfec_4e24_89a0_3949fae01d03.slice/crio-0a0e437780bcf1e92bd1a85ba044fe59e3935a2117b9464294bdec77e9fd83f7 WatchSource:0}: Error finding container 0a0e437780bcf1e92bd1a85ba044fe59e3935a2117b9464294bdec77e9fd83f7: Status 404 returned error can't find the container with id 0a0e437780bcf1e92bd1a85ba044fe59e3935a2117b9464294bdec77e9fd83f7
Jul 26 15:58:04.444922 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.444851    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:04.447264 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.447249    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:04.449322 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.449296    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-99mrw\""
Jul 26 15:58:04.453142 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.453118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:04.581123 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.581092    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b" event={"ID":"7ea0162f-cfec-4e24-89a0-3949fae01d03","Type":"ContainerStarted","Data":"0a0e437780bcf1e92bd1a85ba044fe59e3935a2117b9464294bdec77e9fd83f7"}
Jul 26 15:58:04.602132 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.602097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmrr\" (UniqueName: \"kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr\") pod \"authorino-75d556bd77-c9dtz\" (UID: \"c37bcc0d-5213-4e4e-9b19-a9038103e4cb\") " pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:04.703036 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.702961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmrr\" (UniqueName: \"kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr\") pod \"authorino-75d556bd77-c9dtz\" (UID: \"c37bcc0d-5213-4e4e-9b19-a9038103e4cb\") " pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:04.714810 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.714648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmrr\" (UniqueName: \"kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr\") pod \"authorino-75d556bd77-c9dtz\" (UID: \"c37bcc0d-5213-4e4e-9b19-a9038103e4cb\") " pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:04.757227 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.757201    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:04.925503 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:04.925472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:04.928367 ip-10-0-128-173 kubenswrapper[2576]: W0726 15:58:04.928337    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc37bcc0d_5213_4e4e_9b19_a9038103e4cb.slice/crio-8c3daab75cc47808ff17f020c70a3e94da4646b43aeb91e2896f6e51b71dd115 WatchSource:0}: Error finding container 8c3daab75cc47808ff17f020c70a3e94da4646b43aeb91e2896f6e51b71dd115: Status 404 returned error can't find the container with id 8c3daab75cc47808ff17f020c70a3e94da4646b43aeb91e2896f6e51b71dd115
Jul 26 15:58:05.591177 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:05.591102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c9dtz" event={"ID":"c37bcc0d-5213-4e4e-9b19-a9038103e4cb","Type":"ContainerStarted","Data":"8c3daab75cc47808ff17f020c70a3e94da4646b43aeb91e2896f6e51b71dd115"}
Jul 26 15:58:08.608572 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:08.608539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b" event={"ID":"7ea0162f-cfec-4e24-89a0-3949fae01d03","Type":"ContainerStarted","Data":"16985cab9b4834dc01ab03330f931ed07a2bb30edd4b722d35f32060db3c8b73"}
Jul 26 15:58:08.608994 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:08.608623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:08.610189 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:08.610163    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c9dtz" event={"ID":"c37bcc0d-5213-4e4e-9b19-a9038103e4cb","Type":"ContainerStarted","Data":"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"}
Jul 26 15:58:08.624878 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:08.624836    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b" podStartSLOduration=1.436962527 podStartE2EDuration="5.624822717s" totalImagesPullingTime="4.18786019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:08.623401268 +0000 UTC m=+484.561525600" watchObservedRunningTime="2026-07-26 15:58:08.624822717 +0000 UTC m=+484.562947081"
Jul 26 15:58:08.637683 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:08.637644    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-c9dtz" podStartSLOduration=1.069720278 podStartE2EDuration="4.63763467s" totalImagesPullingTime="3.567914392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 15:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 15:58:08.636390368 +0000 UTC m=+484.574514710" watchObservedRunningTime="2026-07-26 15:58:08.63763467 +0000 UTC m=+484.575758998"
Jul 26 15:58:19.616390 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:19.616361    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"
Jul 26 15:58:37.951176 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:37.951139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:37.951745 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:37.951302    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-c9dtz" podUID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" containerName="authorino" containerID="cri-o://def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267" gracePeriod=30
Jul 26 15:58:38.203571 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.203512    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:38.284508 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.284483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pmrr\" (UniqueName: \"kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr\") pod \"c37bcc0d-5213-4e4e-9b19-a9038103e4cb\" (UID: \"c37bcc0d-5213-4e4e-9b19-a9038103e4cb\") "
Jul 26 15:58:38.286547 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.286514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr" (OuterVolumeSpecName: "kube-api-access-9pmrr") pod "c37bcc0d-5213-4e4e-9b19-a9038103e4cb" (UID: "c37bcc0d-5213-4e4e-9b19-a9038103e4cb"). InnerVolumeSpecName "kube-api-access-9pmrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 15:58:38.385263 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.385230    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pmrr\" (UniqueName: \"kubernetes.io/projected/c37bcc0d-5213-4e4e-9b19-a9038103e4cb-kube-api-access-9pmrr\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 15:58:38.734208 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.734178    2576 generic.go:356] "Generic (PLEG): container finished" podID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" containerID="def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267" exitCode=0
Jul 26 15:58:38.734363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.734223    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-c9dtz"
Jul 26 15:58:38.734363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.734251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c9dtz" event={"ID":"c37bcc0d-5213-4e4e-9b19-a9038103e4cb","Type":"ContainerDied","Data":"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"}
Jul 26 15:58:38.734363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.734279    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-c9dtz" event={"ID":"c37bcc0d-5213-4e4e-9b19-a9038103e4cb","Type":"ContainerDied","Data":"8c3daab75cc47808ff17f020c70a3e94da4646b43aeb91e2896f6e51b71dd115"}
Jul 26 15:58:38.734363 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.734294    2576 scope.go:117] "RemoveContainer" containerID="def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"
Jul 26 15:58:38.742105 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.742090    2576 scope.go:117] "RemoveContainer" containerID="def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"
Jul 26 15:58:38.742343 ip-10-0-128-173 kubenswrapper[2576]: E0726 15:58:38.742322    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267\": container with ID starting with def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267 not found: ID does not exist" containerID="def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"
Jul 26 15:58:38.742409 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.742349    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267"} err="failed to get container status \"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267\": rpc error: code = NotFound desc = could not find container \"def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267\": container with ID starting with def747403fb38ab406cc344190c4866832f053ab6f1db26fdf6baf7e5f325267 not found: ID does not exist"
Jul 26 15:58:38.748260 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.748239    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:38.751558 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:38.751541    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-c9dtz"]
Jul 26 15:58:40.559404 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:58:40.559363    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" path="/var/lib/kubelet/pods/c37bcc0d-5213-4e4e-9b19-a9038103e4cb/volumes"
Jul 26 15:59:19.263284 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:59:19.263255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:59:46.049841 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:59:46.049802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 15:59:54.644232 ip-10-0-128-173 kubenswrapper[2576]: I0726 15:59:54.644204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:00:09.442361 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:09.442326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:00:26.038926 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:26.038893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:00:37.438559 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.438529    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"]
Jul 26 16:00:37.439141 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.439051    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" containerName="authorino"
Jul 26 16:00:37.439141 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.439069    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" containerName="authorino"
Jul 26 16:00:37.439283 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.439230    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c37bcc0d-5213-4e4e-9b19-a9038103e4cb" containerName="authorino"
Jul 26 16:00:37.442304 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.442284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.444678 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.444656    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 16:00:37.444802 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.444677    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8278j\""
Jul 26 16:00:37.444802 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.444744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 16:00:37.445446 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.445430    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 26 16:00:37.451834 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.451813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"]
Jul 26 16:00:37.545318 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.545459 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545322    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.545459 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a0cb171-3333-4d64-a834-74c94c8c0f88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.545459 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.545561 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.545561 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.545529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95g9h\" (UniqueName: \"kubernetes.io/projected/9a0cb171-3333-4d64-a834-74c94c8c0f88-kube-api-access-95g9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.645994 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.645965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646124 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95g9h\" (UniqueName: \"kubernetes.io/projected/9a0cb171-3333-4d64-a834-74c94c8c0f88-kube-api-access-95g9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646194 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646243 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646243 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a0cb171-3333-4d64-a834-74c94c8c0f88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646304 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646342 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646317    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646557 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.646605 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.646590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.648361 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.648338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a0cb171-3333-4d64-a834-74c94c8c0f88-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.648679 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.648660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a0cb171-3333-4d64-a834-74c94c8c0f88-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.655168 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.655138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95g9h\" (UniqueName: \"kubernetes.io/projected/9a0cb171-3333-4d64-a834-74c94c8c0f88-kube-api-access-95g9h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ngrwj\" (UID: \"9a0cb171-3333-4d64-a834-74c94c8c0f88\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.753719 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.753671    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:37.877934 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.877910    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"]
Jul 26 16:00:37.880157 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:00:37.880127    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0cb171_3333_4d64_a834_74c94c8c0f88.slice/crio-68e4e56f4cef8a5251ae9db7096b65b786d0f03e6e9afea1d7d4422dea1f1471 WatchSource:0}: Error finding container 68e4e56f4cef8a5251ae9db7096b65b786d0f03e6e9afea1d7d4422dea1f1471: Status 404 returned error can't find the container with id 68e4e56f4cef8a5251ae9db7096b65b786d0f03e6e9afea1d7d4422dea1f1471
Jul 26 16:00:37.881788 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:37.881774    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:00:38.240412 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:38.240379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj" event={"ID":"9a0cb171-3333-4d64-a834-74c94c8c0f88","Type":"ContainerStarted","Data":"68e4e56f4cef8a5251ae9db7096b65b786d0f03e6e9afea1d7d4422dea1f1471"}
Jul 26 16:00:39.245478 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:39.245446    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj" event={"ID":"9a0cb171-3333-4d64-a834-74c94c8c0f88","Type":"ContainerStarted","Data":"866677d487b7b67bca9933c6cf305732e0a819b4011d7c7b52af8b3ede007b46"}
Jul 26 16:00:39.264443 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:39.264400    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj" podStartSLOduration=1.276541946 podStartE2EDuration="2.264384201s" totalImagesPullingTime="987.842255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:00:39.262480158 +0000 UTC m=+635.200604487" watchObservedRunningTime="2026-07-26 16:00:39.264384201 +0000 UTC m=+635.202508530"
Jul 26 16:00:40.052152 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.052116    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:00:40.641566 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.641528    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"]
Jul 26 16:00:40.645278 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.645257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.647422 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.647402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 26 16:00:40.654058 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.654036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"]
Jul 26 16:00:40.672726 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.672824 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84239f29-6027-4772-b6ad-1da7b62e93f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.672824 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.672916 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.672916 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.672916 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.672875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkb4h\" (UniqueName: \"kubernetes.io/projected/84239f29-6027-4772-b6ad-1da7b62e93f3-kube-api-access-xkb4h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.773967 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.773930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.773967 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.773969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkb4h\" (UniqueName: \"kubernetes.io/projected/84239f29-6027-4772-b6ad-1da7b62e93f3-kube-api-access-xkb4h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774152 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774152 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84239f29-6027-4772-b6ad-1da7b62e93f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774255 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774305 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774381 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774433 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774406    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.774577 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.774559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.776215 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.776183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84239f29-6027-4772-b6ad-1da7b62e93f3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.776415 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.776397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84239f29-6027-4772-b6ad-1da7b62e93f3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.781354 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.781330    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkb4h\" (UniqueName: \"kubernetes.io/projected/84239f29-6027-4772-b6ad-1da7b62e93f3-kube-api-access-xkb4h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s\" (UID: \"84239f29-6027-4772-b6ad-1da7b62e93f3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:40.954356 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:40.954280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:41.080506 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:41.080418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"]
Jul 26 16:00:41.083112 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:00:41.083081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84239f29_6027_4772_b6ad_1da7b62e93f3.slice/crio-e7abe14a72071c350ea58cc729eb5b6543df7fbab23a34af248a489b2a75feb8 WatchSource:0}: Error finding container e7abe14a72071c350ea58cc729eb5b6543df7fbab23a34af248a489b2a75feb8: Status 404 returned error can't find the container with id e7abe14a72071c350ea58cc729eb5b6543df7fbab23a34af248a489b2a75feb8
Jul 26 16:00:41.254287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:41.254261    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s" event={"ID":"84239f29-6027-4772-b6ad-1da7b62e93f3","Type":"ContainerStarted","Data":"e7abe14a72071c350ea58cc729eb5b6543df7fbab23a34af248a489b2a75feb8"}
Jul 26 16:00:42.260413 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:42.260374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s" event={"ID":"84239f29-6027-4772-b6ad-1da7b62e93f3","Type":"ContainerStarted","Data":"6897208a509ef298bb74d77ca513d5448a75c0bf56062a4b19aca70d6df847bf"}
Jul 26 16:00:42.277036 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:42.276979    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s" podStartSLOduration=2.0986397390000002 podStartE2EDuration="2.27696226s" totalImagesPullingTime="178.322521ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:00:42.276441265 +0000 UTC m=+638.214565596" watchObservedRunningTime="2026-07-26 16:00:42.27696226 +0000 UTC m=+638.215086595"
Jul 26 16:00:47.754279 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:47.754239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:47.754778 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:47.754305    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:47.766265 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:47.766240    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:48.298119 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:48.298092    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ngrwj"
Jul 26 16:00:50.955175 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:50.955141    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:50.955539 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:50.955187    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:50.967798 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:50.967769    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:51.310553 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:51.310527    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s"
Jul 26 16:00:52.238476 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:00:52.238438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:02:13.211475 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.211394    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f579c9485-h89wm"]
Jul 26 16:02:13.214763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.214744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.217731 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.217714    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 26 16:02:13.217821 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.217719    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-99mrw\""
Jul 26 16:02:13.222224 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.222203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f579c9485-h89wm"]
Jul 26 16:02:13.292260 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.292221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2b988bf-6139-47a0-a644-00f89132ca42-tls-cert\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.292423 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.292270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd2mg\" (UniqueName: \"kubernetes.io/projected/e2b988bf-6139-47a0-a644-00f89132ca42-kube-api-access-wd2mg\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.392817 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.392760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2b988bf-6139-47a0-a644-00f89132ca42-tls-cert\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.392975 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.392845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd2mg\" (UniqueName: \"kubernetes.io/projected/e2b988bf-6139-47a0-a644-00f89132ca42-kube-api-access-wd2mg\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.395256 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.395225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2b988bf-6139-47a0-a644-00f89132ca42-tls-cert\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.400871 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.400849    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd2mg\" (UniqueName: \"kubernetes.io/projected/e2b988bf-6139-47a0-a644-00f89132ca42-kube-api-access-wd2mg\") pod \"authorino-6f579c9485-h89wm\" (UID: \"e2b988bf-6139-47a0-a644-00f89132ca42\") " pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.524607 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.524573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f579c9485-h89wm"
Jul 26 16:02:13.651350 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:13.651320    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f579c9485-h89wm"]
Jul 26 16:02:13.654543 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:02:13.654516    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2b988bf_6139_47a0_a644_00f89132ca42.slice/crio-86a410d472d477a422d07e32bc35c9e6b54d88a2d29f6a64bed9760da8fc04a5 WatchSource:0}: Error finding container 86a410d472d477a422d07e32bc35c9e6b54d88a2d29f6a64bed9760da8fc04a5: Status 404 returned error can't find the container with id 86a410d472d477a422d07e32bc35c9e6b54d88a2d29f6a64bed9760da8fc04a5
Jul 26 16:02:14.661360 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:14.661310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f579c9485-h89wm" event={"ID":"e2b988bf-6139-47a0-a644-00f89132ca42","Type":"ContainerStarted","Data":"2eb367328477c2bba44a0e938facd4d3965e2d7771c596ce95daa76701bf2f75"}
Jul 26 16:02:14.661360 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:14.661365    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f579c9485-h89wm" event={"ID":"e2b988bf-6139-47a0-a644-00f89132ca42","Type":"ContainerStarted","Data":"86a410d472d477a422d07e32bc35c9e6b54d88a2d29f6a64bed9760da8fc04a5"}
Jul 26 16:02:14.677914 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:14.677858    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f579c9485-h89wm" podStartSLOduration=1.255833994 podStartE2EDuration="1.677841528s" totalImagesPullingTime="422.007534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:02:14.675973361 +0000 UTC m=+730.614097691" watchObservedRunningTime="2026-07-26 16:02:14.677841528 +0000 UTC m=+730.615965859"
Jul 26 16:02:41.543310 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:41.543278    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:02:53.544921 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:02:53.544883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:03:01.236773 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:03:01.236738    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:03:12.843594 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:03:12.843556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:04:48.743656 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:04:48.743618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:05:23.046469 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:05:23.046438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:05:33.034062 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:05:33.034026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:05:42.644864 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:05:42.644826    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:05:52.639302 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:05:52.639268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:06:03.142605 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:06:03.142569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:06:14.037925 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:06:14.037891    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:06:24.948670 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:06:24.945713    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:06:35.141313 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:06:35.141283    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:06:57.539176 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:06:57.539139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:07:08.944408 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:07:08.944363    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:07:32.642463 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:07:32.642422    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:07:43.649635 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:07:43.649599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:07:59.142785 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:07:59.142703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:08:08.640523 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:08:08.640481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:08:20.348202 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:08:20.348172    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:08:32.247279 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:08:32.247243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:10:25.949594 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:10:25.949561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:10:35.335354 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:10:35.335318    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:10:48.743329 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:10:48.743292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:10:59.540876 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:10:59.540803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:11:11.746547 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:11:11.746509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:11:21.051542 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:11:21.051506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:11:30.747939 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:11:30.747900    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:11:40.440121 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:11:40.440090    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:11:52.539749 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:11:52.539718    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:12:01.340356 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:12:01.340324    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:12:12.644335 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:12:12.644298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:12:33.256281 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:12:33.256240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:12:43.574371 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:12:43.574342    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:13:05.638286 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:13:05.638246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:13:21.247622 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:13:21.247589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:13:41.157170 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:13:41.157128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:13:55.946242 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:13:55.946207    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:14:02.739642 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:14:02.739561    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:14:18.546267 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:14:18.546232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:14:32.740197 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:14:32.740156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:14:41.744259 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:14:41.744223    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:14:56.048012 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:14:56.047975    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:15:05.343698 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:15:05.343663    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:15:18.245726 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:15:18.244504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:15:27.359262 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:15:27.359184    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:15:36.549695 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:15:36.549647    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:15:47.942215 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:15:47.942179    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:16:00.056201 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:16:00.056166    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:16:09.749696 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:16:09.749661    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:16:22.345607 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:16:22.345564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:16:34.449866 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:16:34.449833    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:16:47.942437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:16:47.942401    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:17:01.845999 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:17:01.845906    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:17:13.453942 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:17:13.453905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:17:30.741341 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:17:30.741309    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:18:01.642662 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:18:01.642625    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:18:13.941908 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:18:13.941872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:18:45.236364 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:18:45.236325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:18:57.348856 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:18:57.348815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:19:29.050095 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:19:29.050057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:19:41.144882 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:19:41.144846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:20:14.046986 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:20:14.046948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:21:40.853130 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:21:40.853097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:21:50.744448 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:21:50.744410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:22:02.244480 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:22:02.244445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:22:21.336333 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:22:21.336298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:22:57.859717 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:22:57.859626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:23:00.255501 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.255469    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:23:00.258901 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.258882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.261677 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.261657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-631b3d03\"/\"e2e-lifecycle-model-631b3d03-kserve-self-signed-certs\""
Jul 26 16:23:00.262387 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.262370    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-631b3d03\"/\"kube-root-ca.crt\""
Jul 26 16:23:00.262476 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.262373    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-631b3d03\"/\"openshift-service-ca.crt\""
Jul 26 16:23:00.262476 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.262447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-631b3d03\"/\"default-dockercfg-vwmrr\""
Jul 26 16:23:00.278269 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.278248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:23:00.413341 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.413519 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.413519 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.413519 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.413519 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwvn\" (UniqueName: \"kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.413708 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.413565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514539 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514539 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwvn\" (UniqueName: \"kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514794 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514540    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514794 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514794 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.514794 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.514731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.515065 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.515047    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.515126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.515088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.515126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.515109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.516799 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.516778    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.516936 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.516919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.525047 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.525028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwvn\" (UniqueName: \"kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn\") pod \"e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") " pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.567307 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.567283    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:00.699765 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:00.699741    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:23:00.701972 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:23:00.701942    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfcc25ca_b8c5_4973_a615_111bcc45e2f6.slice/crio-a51cdabb02fd63647d679e20b051e20cc680c02ae7e581e0a76a8b93c6ad8cf7 WatchSource:0}: Error finding container a51cdabb02fd63647d679e20b051e20cc680c02ae7e581e0a76a8b93c6ad8cf7: Status 404 returned error can't find the container with id a51cdabb02fd63647d679e20b051e20cc680c02ae7e581e0a76a8b93c6ad8cf7
Jul 26 16:23:01.188529 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:01.188495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" event={"ID":"bfcc25ca-b8c5-4973-a615-111bcc45e2f6","Type":"ContainerStarted","Data":"e1dd61b84bfa11162766c9e9478f19534e6734b4ada02678073b242b9ee81139"}
Jul 26 16:23:01.188529 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:01.188532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" event={"ID":"bfcc25ca-b8c5-4973-a615-111bcc45e2f6","Type":"ContainerStarted","Data":"a51cdabb02fd63647d679e20b051e20cc680c02ae7e581e0a76a8b93c6ad8cf7"}
Jul 26 16:23:01.216590 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:01.216542    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" podStartSLOduration=1.216527457 podStartE2EDuration="1.216527457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:23:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:23:01.215108895 +0000 UTC m=+1977.153233237" watchObservedRunningTime="2026-07-26 16:23:01.216527457 +0000 UTC m=+1977.154651785"
Jul 26 16:23:10.567835 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:10.567799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:10.568277 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:10.567854    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:10.580312 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:10.580291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:10.855201 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:10.855127    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:23:11.244646 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:11.244616    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:23:23.056913 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:23.056874    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:23:35.853139 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:35.853107    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:23:44.249154 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:44.249117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:23:49.301319 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:23:49.301290    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:24:04.320066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.319995    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" podUID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" containerName="main" containerID="cri-o://e1dd61b84bfa11162766c9e9478f19534e6734b4ada02678073b242b9ee81139" gracePeriod=45
Jul 26 16:24:04.468723 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.468676    2576 generic.go:356] "Generic (PLEG): container finished" podID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" containerID="e1dd61b84bfa11162766c9e9478f19534e6734b4ada02678073b242b9ee81139" exitCode=0
Jul 26 16:24:04.468871 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.468723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" event={"ID":"bfcc25ca-b8c5-4973-a615-111bcc45e2f6","Type":"ContainerDied","Data":"e1dd61b84bfa11162766c9e9478f19534e6734b4ada02678073b242b9ee81139"}
Jul 26 16:24:04.563421 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.563400    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:24:04.645418 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645353    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645418 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645418 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645410    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645626 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645430    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645626 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645447    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwwvn\" (UniqueName: \"kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645626 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir\") pod \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\" (UID: \"bfcc25ca-b8c5-4973-a615-111bcc45e2f6\") "
Jul 26 16:24:04.645796 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645679    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:04.645796 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home" (OuterVolumeSpecName: "home") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:04.645950 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.645839    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:04.647432 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.647409    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:24:04.647854 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.647834    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm" (OuterVolumeSpecName: "dshm") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:24:04.647947 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.647836    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn" (OuterVolumeSpecName: "kube-api-access-dwwvn") pod "bfcc25ca-b8c5-4973-a615-111bcc45e2f6" (UID: "bfcc25ca-b8c5-4973-a615-111bcc45e2f6"). InnerVolumeSpecName "kube-api-access-dwwvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:24:04.746778 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746745    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:04.746778 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746768    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:04.746778 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746776    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:04.746968 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746786    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwwvn\" (UniqueName: \"kubernetes.io/projected/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-kube-api-access-dwwvn\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:04.746968 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746795    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:04.746968 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:04.746804    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfcc25ca-b8c5-4973-a615-111bcc45e2f6-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:24:05.474584 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:05.474553    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"
Jul 26 16:24:05.474584 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:05.474569    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h" event={"ID":"bfcc25ca-b8c5-4973-a615-111bcc45e2f6","Type":"ContainerDied","Data":"a51cdabb02fd63647d679e20b051e20cc680c02ae7e581e0a76a8b93c6ad8cf7"}
Jul 26 16:24:05.475172 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:05.474611    2576 scope.go:117] "RemoveContainer" containerID="e1dd61b84bfa11162766c9e9478f19534e6734b4ada02678073b242b9ee81139"
Jul 26 16:24:05.495357 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:05.495330    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:24:05.501329 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:05.501311    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-631b3d03/e2e-lifecycle-model-631b3d03-kserve-57b4ffdf6c-6976h"]
Jul 26 16:24:06.560394 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:06.560364    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" path="/var/lib/kubelet/pods/bfcc25ca-b8c5-4973-a615-111bcc45e2f6/volumes"
Jul 26 16:24:50.641207 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:24:50.641174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:25:00.353676 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:25:00.353643    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:25:53.447968 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:25:53.447930    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:26:05.547243 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:05.547210    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:26:09.350597 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.350563    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:26:09.351001 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.350915    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" containerName="main"
Jul 26 16:26:09.351001 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.350927    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" containerName="main"
Jul 26 16:26:09.351001 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.350992    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfcc25ca-b8c5-4973-a615-111bcc45e2f6" containerName="main"
Jul 26 16:26:09.353839 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.353823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.357574 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.357546    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54fb7c\"/\"kube-root-ca.crt\""
Jul 26 16:26:09.357574 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.357562    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54fb7c\"/\"test-model-54fb7c-kserve-self-signed-certs\""
Jul 26 16:26:09.357754 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.357578    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-54fb7c\"/\"openshift-service-ca.crt\""
Jul 26 16:26:09.357754 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.357551    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-54fb7c\"/\"default-dockercfg-mq5xd\""
Jul 26 16:26:09.367770 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.367750    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:26:09.482663 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.482832 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.482832 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.482832 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qzz\" (UniqueName: \"kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.482933 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.482966 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.482933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qzz\" (UniqueName: \"kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584548 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584612 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584571    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.584663 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.584616    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.586546 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.586526    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.586728 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.586712    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.592348 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.592331    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qzz\" (UniqueName: \"kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz\") pod \"test-model-54fb7c-kserve-689c868799-5jjnr\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") " pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.662427 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.662346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:09.789126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:09.789097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:26:09.793437 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:26:09.793410    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec9538c2_5b21_42c4_9a3e_22cbc3120f9c.slice/crio-c3f27962da9a48121b2e3779d2ebaa1fe58e306c4c5910704b62cc3880996ecd WatchSource:0}: Error finding container c3f27962da9a48121b2e3779d2ebaa1fe58e306c4c5910704b62cc3880996ecd: Status 404 returned error can't find the container with id c3f27962da9a48121b2e3779d2ebaa1fe58e306c4c5910704b62cc3880996ecd
Jul 26 16:26:10.020762 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:10.020728    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" event={"ID":"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c","Type":"ContainerStarted","Data":"33672ef838a6011c432f924bc248e78a6e3d3591db9e392087a90adc5f1f6d87"}
Jul 26 16:26:10.020918 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:10.020771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" event={"ID":"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c","Type":"ContainerStarted","Data":"c3f27962da9a48121b2e3779d2ebaa1fe58e306c4c5910704b62cc3880996ecd"}
Jul 26 16:26:10.037993 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:10.037950    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" podStartSLOduration=1.037934579 podStartE2EDuration="1.037934579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:26:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:26:10.036616683 +0000 UTC m=+2165.974741013" watchObservedRunningTime="2026-07-26 16:26:10.037934579 +0000 UTC m=+2165.976058899"
Jul 26 16:26:13.940676 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:13.940633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:26:19.662773 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:19.662730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:19.663151 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:19.662798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:19.675367 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:19.675339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:20.081024 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:20.080995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:26:26.344075 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:26.344041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:26:42.551452 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:42.551418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:26:56.545238 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:26:56.545204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:27:18.182816 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:18.182777    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:27:23.347598 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:23.347558    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:27:33.205547 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.205469    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" podUID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" containerName="main" containerID="cri-o://33672ef838a6011c432f924bc248e78a6e3d3591db9e392087a90adc5f1f6d87" gracePeriod=45
Jul 26 16:27:33.389879 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.389846    2576 generic.go:356] "Generic (PLEG): container finished" podID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" containerID="33672ef838a6011c432f924bc248e78a6e3d3591db9e392087a90adc5f1f6d87" exitCode=0
Jul 26 16:27:33.390040 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.389907    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" event={"ID":"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c","Type":"ContainerDied","Data":"33672ef838a6011c432f924bc248e78a6e3d3591db9e392087a90adc5f1f6d87"}
Jul 26 16:27:33.457240 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.457183    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:27:33.509015 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.508989    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7qzz\" (UniqueName: \"kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509176 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509028    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509176 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509067    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509176 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509111    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509325 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509325 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509212    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache\") pod \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\" (UID: \"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c\") "
Jul 26 16:27:33.509405 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509344    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home" (OuterVolumeSpecName: "home") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:33.509405 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:33.509495 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509466    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:33.509538 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509519    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:33.509538 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.509532    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:33.511222 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.511190    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm" (OuterVolumeSpecName: "dshm") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:27:33.511324 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.511216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:27:33.511324 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.511268    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz" (OuterVolumeSpecName: "kube-api-access-v7qzz") pod "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" (UID: "ec9538c2-5b21-42c4-9a3e-22cbc3120f9c"). InnerVolumeSpecName "kube-api-access-v7qzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:27:33.610858 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.610835    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:33.610858 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.610855    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:33.610858 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.610865    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7qzz\" (UniqueName: \"kubernetes.io/projected/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-kube-api-access-v7qzz\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:33.611133 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:33.610874    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:27:34.395606 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.395579    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"
Jul 26 16:27:34.395606 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.395597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr" event={"ID":"ec9538c2-5b21-42c4-9a3e-22cbc3120f9c","Type":"ContainerDied","Data":"c3f27962da9a48121b2e3779d2ebaa1fe58e306c4c5910704b62cc3880996ecd"}
Jul 26 16:27:34.396100 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.395647    2576 scope.go:117] "RemoveContainer" containerID="33672ef838a6011c432f924bc248e78a6e3d3591db9e392087a90adc5f1f6d87"
Jul 26 16:27:34.421016 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.420991    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:27:34.424923 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.424903    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-54fb7c/test-model-54fb7c-kserve-689c868799-5jjnr"]
Jul 26 16:27:34.560897 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:34.560862    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" path="/var/lib/kubelet/pods/ec9538c2-5b21-42c4-9a3e-22cbc3120f9c/volumes"
Jul 26 16:27:38.955158 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:38.955120    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:27:54.746286 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:27:54.746249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:28:10.141782 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:28:10.141742    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:28:26.257455 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:28:26.257418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:28:45.943546 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:28:45.943512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:29:14.245570 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:14.245540    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:29:30.650458 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:30.650419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:29:43.861374 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:43.861340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:29:50.745225 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.745187    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:29:50.745771 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.745628    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" containerName="main"
Jul 26 16:29:50.745771 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.745646    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" containerName="main"
Jul 26 16:29:50.745771 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.745747    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9538c2-5b21-42c4-9a3e-22cbc3120f9c" containerName="main"
Jul 26 16:29:50.748792 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.748774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.751590 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.751568    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"auth-test-model-76272d-kserve-self-signed-certs\""
Jul 26 16:29:50.752291 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.752272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"kube-root-ca.crt\""
Jul 26 16:29:50.752417 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.752402    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"openshift-service-ca.crt\""
Jul 26 16:29:50.752502 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.752488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"default-dockercfg-rgg8b\""
Jul 26 16:29:50.758460 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.758439    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:29:50.779773 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.779895 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.779895 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wkr\" (UniqueName: \"kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.779895 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.780066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.780066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.779998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.880912 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.880882    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881042 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.880920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881042 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.880985    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881042 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881042 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wkr\" (UniqueName: \"kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881238 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881344 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881321    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881467 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.881467 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.881394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.883210 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.883190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.883362 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.883340    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:50.889071 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:50.889051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wkr\" (UniqueName: \"kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr\") pod \"auth-test-model-76272d-kserve-7f76fb86c-t7nhs\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") " pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:51.058273 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:51.058198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:29:51.186306 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:51.186285    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:29:51.188825 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:29:51.188798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda79ff650_a0ff_49b8_81e0_6b91c65d22f7.slice/crio-3c3b448b3be95b18d7a60b6a095d23119c817fffdd7b746e472622818ab2be80 WatchSource:0}: Error finding container 3c3b448b3be95b18d7a60b6a095d23119c817fffdd7b746e472622818ab2be80: Status 404 returned error can't find the container with id 3c3b448b3be95b18d7a60b6a095d23119c817fffdd7b746e472622818ab2be80
Jul 26 16:29:52.001453 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:52.001419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" event={"ID":"a79ff650-a0ff-49b8-81e0-6b91c65d22f7","Type":"ContainerStarted","Data":"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"}
Jul 26 16:29:52.001453 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:52.001457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" event={"ID":"a79ff650-a0ff-49b8-81e0-6b91c65d22f7","Type":"ContainerStarted","Data":"3c3b448b3be95b18d7a60b6a095d23119c817fffdd7b746e472622818ab2be80"}
Jul 26 16:29:52.023180 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:52.023129    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" podStartSLOduration=2.023114113 podStartE2EDuration="2.023114113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:29:52.021038332 +0000 UTC m=+2387.959162662" watchObservedRunningTime="2026-07-26 16:29:52.023114113 +0000 UTC m=+2387.961238444"
Jul 26 16:29:56.047346 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:29:56.047312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:30:01.058543 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:01.058515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:30:01.058996 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:01.058571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:30:01.070869 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:01.070846    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:30:02.063795 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:02.063762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:30:35.743838 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:35.743803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:30:59.655025 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:30:59.654990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:31:26.637139 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:31:26.637100    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:31:45.140118 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:31:45.140085    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:32:07.239801 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:32:07.239711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:32:26.384063 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:32:26.384024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:32:49.041055 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:32:49.041016    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:33:07.553969 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:33:07.553936    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:33:34.939486 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:33:34.939449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:33:51.252912 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:33:51.252873    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:34:19.047217 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:34:19.047178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:34:32.651872 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:34:32.651838    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:34:44.551096 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:34:44.551059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:35:07.852764 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:07.852682    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:35:12.358206 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:12.358170    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:35:24.648534 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:24.648498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:35:27.377146 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.377101    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" podUID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" containerName="main" containerID="cri-o://df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86" gracePeriod=45
Jul 26 16:35:27.612093 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.612068    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:35:27.734895 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.734868    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735070 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.734919    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735070 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.734952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735070 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.734993    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735070 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735019    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735070 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735039    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5wkr\" (UniqueName: \"kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr\") pod \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\" (UID: \"a79ff650-a0ff-49b8-81e0-6b91c65d22f7\") "
Jul 26 16:35:27.735314 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home" (OuterVolumeSpecName: "home") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:27.735314 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735221    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:27.735314 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735288    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:27.735425 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735343    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:27.735425 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.735356    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:27.737218 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.737189    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:35:27.737312 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.737218    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm" (OuterVolumeSpecName: "dshm") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:35:27.737312 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.737235    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr" (OuterVolumeSpecName: "kube-api-access-l5wkr") pod "a79ff650-a0ff-49b8-81e0-6b91c65d22f7" (UID: "a79ff650-a0ff-49b8-81e0-6b91c65d22f7"). InnerVolumeSpecName "kube-api-access-l5wkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:35:27.836202 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.836170    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:27.836202 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.836196    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:27.836202 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.836206    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5wkr\" (UniqueName: \"kubernetes.io/projected/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-kube-api-access-l5wkr\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:27.836417 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:27.836214    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a79ff650-a0ff-49b8-81e0-6b91c65d22f7-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:35:28.492433 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.492399    2576 generic.go:356] "Generic (PLEG): container finished" podID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" containerID="df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86" exitCode=0
Jul 26 16:35:28.492920 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.492455    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"
Jul 26 16:35:28.492920 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.492501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" event={"ID":"a79ff650-a0ff-49b8-81e0-6b91c65d22f7","Type":"ContainerDied","Data":"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"}
Jul 26 16:35:28.492920 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.492554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs" event={"ID":"a79ff650-a0ff-49b8-81e0-6b91c65d22f7","Type":"ContainerDied","Data":"3c3b448b3be95b18d7a60b6a095d23119c817fffdd7b746e472622818ab2be80"}
Jul 26 16:35:28.492920 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.492579    2576 scope.go:117] "RemoveContainer" containerID="df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"
Jul 26 16:35:28.500995 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.500980    2576 scope.go:117] "RemoveContainer" containerID="df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"
Jul 26 16:35:28.501226 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:35:28.501210    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86\": container with ID starting with df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86 not found: ID does not exist" containerID="df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"
Jul 26 16:35:28.501264 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.501234    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86"} err="failed to get container status \"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86\": rpc error: code = NotFound desc = could not find container \"df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86\": container with ID starting with df268b787231be313214d4e7a2d87d6c6a31031cb55c76e8972c003d55f18c86 not found: ID does not exist"
Jul 26 16:35:28.521441 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.521418    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:35:28.527076 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.527057    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/auth-test-model-76272d-kserve-7f76fb86c-t7nhs"]
Jul 26 16:35:28.560128 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:28.560104    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" path="/var/lib/kubelet/pods/a79ff650-a0ff-49b8-81e0-6b91c65d22f7/volumes"
Jul 26 16:35:53.359393 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.359356    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:35:53.359896 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.359876    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" containerName="main"
Jul 26 16:35:53.359938 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.359901    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" containerName="main"
Jul 26 16:35:53.360015 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.360003    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a79ff650-a0ff-49b8-81e0-6b91c65d22f7" containerName="main"
Jul 26 16:35:53.363203 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.363183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.367159 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.367136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"default-dockercfg-mvccj\""
Jul 26 16:35:53.367287 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.367266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"sub-test-model-99124e-kserve-self-signed-certs\""
Jul 26 16:35:53.367370 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.367279    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"kube-root-ca.crt\""
Jul 26 16:35:53.367427 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.367300    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-99124e\"/\"openshift-service-ca.crt\""
Jul 26 16:35:53.374270 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.374248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:35:53.553865 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.553865 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.554057 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd8h8\" (UniqueName: \"kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.554057 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.554057 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.554057 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.553961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655524 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655524 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd8h8\" (UniqueName: \"kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.655763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.655652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.656027 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.656004    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.656084 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.656045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.656145 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.656046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.657794 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.657776    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.658034 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.658017    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.666398 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.666375    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd8h8\" (UniqueName: \"kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8\") pod \"sub-test-model-99124e-kserve-c498c964c-khrwh\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") " pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.672260 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.672237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:35:53.801481 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:53.801408    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:35:53.803807 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:35:53.803775    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37e759c3_d3ba_4016_919b_6258cf32d927.slice/crio-57249926d61f884b7b9917ea6261bd7216f13798f26567b9ab2681a23acdbd6d WatchSource:0}: Error finding container 57249926d61f884b7b9917ea6261bd7216f13798f26567b9ab2681a23acdbd6d: Status 404 returned error can't find the container with id 57249926d61f884b7b9917ea6261bd7216f13798f26567b9ab2681a23acdbd6d
Jul 26 16:35:54.607309 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:54.607269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" event={"ID":"37e759c3-d3ba-4016-919b-6258cf32d927","Type":"ContainerStarted","Data":"28ad65c7b1069c15ca57c265188c13c4ea5733281af09bc6d365ebcf64785ed0"}
Jul 26 16:35:54.607309 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:54.607312    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" event={"ID":"37e759c3-d3ba-4016-919b-6258cf32d927","Type":"ContainerStarted","Data":"57249926d61f884b7b9917ea6261bd7216f13798f26567b9ab2681a23acdbd6d"}
Jul 26 16:35:54.623904 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:54.623853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" podStartSLOduration=1.623839021 podStartE2EDuration="1.623839021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:35:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:35:54.623303924 +0000 UTC m=+2750.561428268" watchObservedRunningTime="2026-07-26 16:35:54.623839021 +0000 UTC m=+2750.561963329"
Jul 26 16:35:56.848983 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:35:56.848946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:36:03.673235 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:03.673201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:36:03.675431 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:03.673288    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:36:03.685416 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:03.685396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:36:04.667609 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:04.667577    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:36:38.094622 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:38.094590    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:36:58.750754 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:36:58.750677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:37:04.826788 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:04.826749    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:37:09.067434 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.067403    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:37:09.070825 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.070805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.074019 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.073998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"default-dockercfg-rgg8b\""
Jul 26 16:37:09.074115 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.074039    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"kube-root-ca.crt\""
Jul 26 16:37:09.074115 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.074039    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"openshift-service-ca.crt\""
Jul 26 16:37:09.074328 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.074312    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-76272d\"/\"rate-test-model-76272d-kserve-self-signed-certs\""
Jul 26 16:37:09.080494 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.080471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:37:09.230767 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.230981 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.230981 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.230981 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8kt9\" (UniqueName: \"kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.230981 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.230981 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.230941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.331988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332066 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332050    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8kt9\" (UniqueName: \"kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332302 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332302 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332302 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332468 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332523 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332499    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.332616 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.332591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.334197 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.334179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.334454 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.334438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.339868 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.339851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8kt9\" (UniqueName: \"kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9\") pod \"rate-test-model-76272d-kserve-6bdc785d7f-w6wgx\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") " pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.380665 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.380639    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:09.515030 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.512055    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:37:09.515499 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:37:09.515478    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc0e28a9_d87b_4ed9_86e0_2d14f862b179.slice/crio-99abfb5bd24be1fb23d75e8f484e2aa95b3f73e4e5d7796c8fea9dda81bad6e3 WatchSource:0}: Error finding container 99abfb5bd24be1fb23d75e8f484e2aa95b3f73e4e5d7796c8fea9dda81bad6e3: Status 404 returned error can't find the container with id 99abfb5bd24be1fb23d75e8f484e2aa95b3f73e4e5d7796c8fea9dda81bad6e3
Jul 26 16:37:09.943929 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.943895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" event={"ID":"dc0e28a9-d87b-4ed9-86e0-2d14f862b179","Type":"ContainerStarted","Data":"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"}
Jul 26 16:37:09.943929 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.943945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" event={"ID":"dc0e28a9-d87b-4ed9-86e0-2d14f862b179","Type":"ContainerStarted","Data":"99abfb5bd24be1fb23d75e8f484e2aa95b3f73e4e5d7796c8fea9dda81bad6e3"}
Jul 26 16:37:09.962149 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:09.962091    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" podStartSLOduration=0.962073814 podStartE2EDuration="962.073814ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:37:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:37:09.961268058 +0000 UTC m=+2825.899392387" watchObservedRunningTime="2026-07-26 16:37:09.962073814 +0000 UTC m=+2825.900198146"
Jul 26 16:37:15.147190 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:15.147154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:37:19.381736 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.381662    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:19.382155 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.381765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:19.394272 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.394244    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:19.845396 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.845358    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" podUID="37e759c3-d3ba-4016-919b-6258cf32d927" containerName="main" containerID="cri-o://28ad65c7b1069c15ca57c265188c13c4ea5733281af09bc6d365ebcf64785ed0" gracePeriod=45
Jul 26 16:37:19.990057 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.990023    2576 generic.go:356] "Generic (PLEG): container finished" podID="37e759c3-d3ba-4016-919b-6258cf32d927" containerID="28ad65c7b1069c15ca57c265188c13c4ea5733281af09bc6d365ebcf64785ed0" exitCode=0
Jul 26 16:37:19.990222 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:19.990095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" event={"ID":"37e759c3-d3ba-4016-919b-6258cf32d927","Type":"ContainerDied","Data":"28ad65c7b1069c15ca57c265188c13c4ea5733281af09bc6d365ebcf64785ed0"}
Jul 26 16:37:20.002105 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.002079    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:37:20.092091 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.092067    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:37:20.126712 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126610    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.126712 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126652    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.126948 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd8h8\" (UniqueName: \"kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.126948 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126791    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.126948 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126815    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.127105 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.126950    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home\") pod \"37e759c3-d3ba-4016-919b-6258cf32d927\" (UID: \"37e759c3-d3ba-4016-919b-6258cf32d927\") "
Jul 26 16:37:20.127105 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.127017    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:20.127273 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.127252    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache" (OuterVolumeSpecName: "model-cache") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:20.127375 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.127267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home" (OuterVolumeSpecName: "home") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:20.127431 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.127298    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.129417 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.129392    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8" (OuterVolumeSpecName: "kube-api-access-vd8h8") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "kube-api-access-vd8h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:37:20.129417 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.129396    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm" (OuterVolumeSpecName: "dshm") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:37:20.129546 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.129477    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37e759c3-d3ba-4016-919b-6258cf32d927" (UID: "37e759c3-d3ba-4016-919b-6258cf32d927"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:37:20.228527 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.228488    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.228527 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.228523    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.228775 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.228546    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd8h8\" (UniqueName: \"kubernetes.io/projected/37e759c3-d3ba-4016-919b-6258cf32d927-kube-api-access-vd8h8\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.228775 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.228558    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37e759c3-d3ba-4016-919b-6258cf32d927-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.228775 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.228569    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37e759c3-d3ba-4016-919b-6258cf32d927-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:37:20.996522 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.996484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh" event={"ID":"37e759c3-d3ba-4016-919b-6258cf32d927","Type":"ContainerDied","Data":"57249926d61f884b7b9917ea6261bd7216f13798f26567b9ab2681a23acdbd6d"}
Jul 26 16:37:20.996522 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.996519    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"
Jul 26 16:37:20.997020 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:20.996549    2576 scope.go:117] "RemoveContainer" containerID="28ad65c7b1069c15ca57c265188c13c4ea5733281af09bc6d365ebcf64785ed0"
Jul 26 16:37:21.012556 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:21.012515    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:37:21.014786 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:21.014766    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-99124e/sub-test-model-99124e-kserve-c498c964c-khrwh"]
Jul 26 16:37:22.560169 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:22.560138    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37e759c3-d3ba-4016-919b-6258cf32d927" path="/var/lib/kubelet/pods/37e759c3-d3ba-4016-919b-6258cf32d927/volumes"
Jul 26 16:37:37.665659 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:37:37.665619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:38:08.040387 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:08.040353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:38:22.212677 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:22.212634    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:38:37.708300 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:37.708267    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:38:42.484803 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:42.484769    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:38:47.948283 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.948244    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884531760"]
Jul 26 16:38:47.948635 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.948588    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37e759c3-d3ba-4016-919b-6258cf32d927" containerName="main"
Jul 26 16:38:47.948635 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.948601    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="37e759c3-d3ba-4016-919b-6258cf32d927" containerName="main"
Jul 26 16:38:47.948734 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.948665    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="37e759c3-d3ba-4016-919b-6258cf32d927" containerName="main"
Jul 26 16:38:47.951442 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.951426    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:47.954592 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:47.954571    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bplww\""
Jul 26 16:38:48.047106 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.047068    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884531760"]
Jul 26 16:38:48.090281 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.090253    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kpvk\" (UniqueName: \"kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk\") pod \"test-curl-7652-139656884531760\" (UID: \"e1ffc819-1c1e-40c5-a4fa-9c2c33929756\") " pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:48.191372 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.191339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kpvk\" (UniqueName: \"kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk\") pod \"test-curl-7652-139656884531760\" (UID: \"e1ffc819-1c1e-40c5-a4fa-9c2c33929756\") " pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:48.202563 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.202501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kpvk\" (UniqueName: \"kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk\") pod \"test-curl-7652-139656884531760\" (UID: \"e1ffc819-1c1e-40c5-a4fa-9c2c33929756\") " pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:48.259619 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.259593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:48.412018 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.411988    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884531760"]
Jul 26 16:38:48.415074 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:38:48.415050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1ffc819_1c1e_40c5_a4fa_9c2c33929756.slice/crio-b90fcc125a266ebd10490a9e1fa5595b7f59c52cad68e838475fb72e974ce809 WatchSource:0}: Error finding container b90fcc125a266ebd10490a9e1fa5595b7f59c52cad68e838475fb72e974ce809: Status 404 returned error can't find the container with id b90fcc125a266ebd10490a9e1fa5595b7f59c52cad68e838475fb72e974ce809
Jul 26 16:38:48.416237 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:48.416219    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 16:38:49.390859 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:49.390778    2576 generic.go:356] "Generic (PLEG): container finished" podID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" containerID="a0f5e2237fbba5186f1547ef9c215873ed2a3306ce416e5fe348b0a17eaade37" exitCode=0
Jul 26 16:38:49.391190 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:49.390870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884531760" event={"ID":"e1ffc819-1c1e-40c5-a4fa-9c2c33929756","Type":"ContainerDied","Data":"a0f5e2237fbba5186f1547ef9c215873ed2a3306ce416e5fe348b0a17eaade37"}
Jul 26 16:38:49.391190 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:49.390912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884531760" event={"ID":"e1ffc819-1c1e-40c5-a4fa-9c2c33929756","Type":"ContainerStarted","Data":"b90fcc125a266ebd10490a9e1fa5595b7f59c52cad68e838475fb72e974ce809"}
Jul 26 16:38:50.525742 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.525719    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:50.584838 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.584810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884531760_e1ffc819-1c1e-40c5-a4fa-9c2c33929756/test-curl-7652-139656884531760/0.log"
Jul 26 16:38:50.611043 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.611017    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kpvk\" (UniqueName: \"kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk\") pod \"e1ffc819-1c1e-40c5-a4fa-9c2c33929756\" (UID: \"e1ffc819-1c1e-40c5-a4fa-9c2c33929756\") "
Jul 26 16:38:50.613063 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.613043    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk" (OuterVolumeSpecName: "kube-api-access-6kpvk") pod "e1ffc819-1c1e-40c5-a4fa-9c2c33929756" (UID: "e1ffc819-1c1e-40c5-a4fa-9c2c33929756"). InnerVolumeSpecName "kube-api-access-6kpvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:50.621500 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.621479    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884531760"]
Jul 26 16:38:50.627073 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.627052    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884531760"]
Jul 26 16:38:50.711721 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.711646    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kpvk\" (UniqueName: \"kubernetes.io/projected/e1ffc819-1c1e-40c5-a4fa-9c2c33929756-kube-api-access-6kpvk\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:50.784565 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:50.784530    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:38:51.401255 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:51.401225    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b90fcc125a266ebd10490a9e1fa5595b7f59c52cad68e838475fb72e974ce809"
Jul 26 16:38:51.401440 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:51.401281    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:51.412411 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:38:51.412380    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7652-139656884531760\" is forbidden: User \"system:node:ip-10-0-128-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-173.ec2.internal' and this object" podUID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" pod="opendatahub/test-curl-7652-139656884531760"
Jul 26 16:38:52.560062 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:52.560020    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" path="/var/lib/kubelet/pods/e1ffc819-1c1e-40c5-a4fa-9c2c33929756/volumes"
Jul 26 16:38:57.502801 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.502759    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" podUID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" containerName="main" containerID="cri-o://2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8" gracePeriod=45
Jul 26 16:38:57.753938 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.753887    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:38:57.878888 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.878855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8kt9\" (UniqueName: \"kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.878888 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.878892    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.879137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.878991    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.879137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.879137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.879137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879076    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir\") pod \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\" (UID: \"dc0e28a9-d87b-4ed9-86e0-2d14f862b179\") "
Jul 26 16:38:57.879346 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879197    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache" (OuterVolumeSpecName: "model-cache") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:57.879346 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879335    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:57.879445 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879345    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home" (OuterVolumeSpecName: "home") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:57.879445 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.879364    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:57.881021 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.880989    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9" (OuterVolumeSpecName: "kube-api-access-c8kt9") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "kube-api-access-c8kt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:38:57.881413 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.881397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm" (OuterVolumeSpecName: "dshm") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:38:57.881413 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.881401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dc0e28a9-d87b-4ed9-86e0-2d14f862b179" (UID: "dc0e28a9-d87b-4ed9-86e0-2d14f862b179"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:38:57.980126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.980100    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:57.980126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.980122    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:57.980126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.980131    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:57.980297 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.980139    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:57.980297 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:57.980147    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8kt9\" (UniqueName: \"kubernetes.io/projected/dc0e28a9-d87b-4ed9-86e0-2d14f862b179-kube-api-access-c8kt9\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:38:58.435902 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.435866    2576 generic.go:356] "Generic (PLEG): container finished" podID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" containerID="2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8" exitCode=0
Jul 26 16:38:58.436107 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.435910    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"
Jul 26 16:38:58.436107 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.435945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" event={"ID":"dc0e28a9-d87b-4ed9-86e0-2d14f862b179","Type":"ContainerDied","Data":"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"}
Jul 26 16:38:58.436107 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.435999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx" event={"ID":"dc0e28a9-d87b-4ed9-86e0-2d14f862b179","Type":"ContainerDied","Data":"99abfb5bd24be1fb23d75e8f484e2aa95b3f73e4e5d7796c8fea9dda81bad6e3"}
Jul 26 16:38:58.436107 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.436015    2576 scope.go:117] "RemoveContainer" containerID="2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"
Jul 26 16:38:58.450519 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.450500    2576 scope.go:117] "RemoveContainer" containerID="2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"
Jul 26 16:38:58.450809 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:38:58.450789    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8\": container with ID starting with 2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8 not found: ID does not exist" containerID="2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"
Jul 26 16:38:58.450874 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.450818    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8"} err="failed to get container status \"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8\": rpc error: code = NotFound desc = could not find container \"2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8\": container with ID starting with 2e2c022b363238b7df89d9cb38d200ae089a8c39ff55d24d171c75b2c0b0e0a8 not found: ID does not exist"
Jul 26 16:38:58.482059 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.482033    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:38:58.486119 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.486096    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-76272d/rate-test-model-76272d-kserve-6bdc785d7f-w6wgx"]
Jul 26 16:38:58.559536 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:58.559499    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" path="/var/lib/kubelet/pods/dc0e28a9-d87b-4ed9-86e0-2d14f862b179/volumes"
Jul 26 16:38:59.960618 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.960585    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:59.960987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.960931    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" containerName="main"
Jul 26 16:38:59.960987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.960942    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" containerName="main"
Jul 26 16:38:59.960987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.960957    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" containerName="test-curl-7652-139656884531760"
Jul 26 16:38:59.960987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.960963    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" containerName="test-curl-7652-139656884531760"
Jul 26 16:38:59.961112 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.961018    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1ffc819-1c1e-40c5-a4fa-9c2c33929756" containerName="test-curl-7652-139656884531760"
Jul 26 16:38:59.961112 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.961027    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc0e28a9-d87b-4ed9-86e0-2d14f862b179" containerName="main"
Jul 26 16:38:59.965252 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.965235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:38:59.973115 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.973090    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-bplww\""
Jul 26 16:38:59.984699 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.984664    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:38:59.996259 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:38:59.996235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2s7g\" (UniqueName: \"kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g\") pod \"test-curl-7652-139656884349664\" (UID: \"86caced3-3bd0-4096-b35a-c43616abcb5f\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:00.097190 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:00.097163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s7g\" (UniqueName: \"kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g\") pod \"test-curl-7652-139656884349664\" (UID: \"86caced3-3bd0-4096-b35a-c43616abcb5f\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:00.109618 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:00.109595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2s7g\" (UniqueName: \"kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g\") pod \"test-curl-7652-139656884349664\" (UID: \"86caced3-3bd0-4096-b35a-c43616abcb5f\") " pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:00.274298 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:00.274274    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:00.616747 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:00.616661    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:39:00.620015 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:39:00.619990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86caced3_3bd0_4096_b35a_c43616abcb5f.slice/crio-f9cfbe22f6cc4a25d66dac7611f20079031c4d07c2022a0c89096af17ad33c77 WatchSource:0}: Error finding container f9cfbe22f6cc4a25d66dac7611f20079031c4d07c2022a0c89096af17ad33c77: Status 404 returned error can't find the container with id f9cfbe22f6cc4a25d66dac7611f20079031c4d07c2022a0c89096af17ad33c77
Jul 26 16:39:01.451752 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:01.451713    2576 generic.go:356] "Generic (PLEG): container finished" podID="86caced3-3bd0-4096-b35a-c43616abcb5f" containerID="795eac32e4e65fc5031ce4fa671a77c2094d90ddaffc2ef89c9d3a6a9245a742" exitCode=0
Jul 26 16:39:01.452137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:01.451761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884349664" event={"ID":"86caced3-3bd0-4096-b35a-c43616abcb5f","Type":"ContainerDied","Data":"795eac32e4e65fc5031ce4fa671a77c2094d90ddaffc2ef89c9d3a6a9245a742"}
Jul 26 16:39:01.452137 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:01.451790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7652-139656884349664" event={"ID":"86caced3-3bd0-4096-b35a-c43616abcb5f","Type":"ContainerStarted","Data":"f9cfbe22f6cc4a25d66dac7611f20079031c4d07c2022a0c89096af17ad33c77"}
Jul 26 16:39:02.581181 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.581157    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:02.617955 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.617932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2s7g\" (UniqueName: \"kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g\") pod \"86caced3-3bd0-4096-b35a-c43616abcb5f\" (UID: \"86caced3-3bd0-4096-b35a-c43616abcb5f\") "
Jul 26 16:39:02.620474 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.620446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g" (OuterVolumeSpecName: "kube-api-access-d2s7g") pod "86caced3-3bd0-4096-b35a-c43616abcb5f" (UID: "86caced3-3bd0-4096-b35a-c43616abcb5f"). InnerVolumeSpecName "kube-api-access-d2s7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:39:02.629301 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.629283    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7652-139656884349664_86caced3-3bd0-4096-b35a-c43616abcb5f/test-curl-7652-139656884349664/0.log"
Jul 26 16:39:02.674441 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.674417    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:39:02.687352 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.687331    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7652-139656884349664"]
Jul 26 16:39:02.718879 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:02.718831    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2s7g\" (UniqueName: \"kubernetes.io/projected/86caced3-3bd0-4096-b35a-c43616abcb5f-kube-api-access-d2s7g\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:39:03.467245 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:03.467215    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9cfbe22f6cc4a25d66dac7611f20079031c4d07c2022a0c89096af17ad33c77"
Jul 26 16:39:03.467462 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:03.467277    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:03.477835 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:39:03.477806    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7652-139656884349664\" is forbidden: User \"system:node:ip-10-0-128-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-173.ec2.internal' and this object" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:04.560138 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:39:04.560102    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7652-139656884349664\" is forbidden: User \"system:node:ip-10-0-128-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-173.ec2.internal' and this object" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" pod="opendatahub/test-curl-7652-139656884349664"
Jul 26 16:39:04.560517 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:04.560497    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" path="/var/lib/kubelet/pods/86caced3-3bd0-4096-b35a-c43616abcb5f/volumes"
Jul 26 16:39:14.661336 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:14.661307    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:39:33.291753 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.291718    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:39:33.292228 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.292060    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:33.292228 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.292071    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:33.292228 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.292130    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="86caced3-3bd0-4096-b35a-c43616abcb5f" containerName="test-curl-7652-139656884349664"
Jul 26 16:39:33.296522 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.296502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.299020 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.298996    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-33839d\""
Jul 26 16:39:33.299191 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.299172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-33839d-dockercfg-dth5h\""
Jul 26 16:39:33.313523 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.313496    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:39:33.386318 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.386278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.386483 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.386396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thh7w\" (UniqueName: \"kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.487740 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.487677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thh7w\" (UniqueName: \"kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.487911 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.487788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.488434 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.488416    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.497341 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.497308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thh7w\" (UniqueName: \"kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w\") pod \"payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.606276 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.606191    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:33.735472 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:33.735445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:39:33.737727 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:39:33.737700    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e99f9d_9a81_4765_b2b4_6adeeabe6443.slice/crio-08206128649d0d99febc0071fff45dc989275b34df4e8834ef1cdd349fc9f5cf WatchSource:0}: Error finding container 08206128649d0d99febc0071fff45dc989275b34df4e8834ef1cdd349fc9f5cf: Status 404 returned error can't find the container with id 08206128649d0d99febc0071fff45dc989275b34df4e8834ef1cdd349fc9f5cf
Jul 26 16:39:34.607145 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:34.607105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" event={"ID":"12e99f9d-9a81-4765-b2b4-6adeeabe6443","Type":"ContainerStarted","Data":"08206128649d0d99febc0071fff45dc989275b34df4e8834ef1cdd349fc9f5cf"}
Jul 26 16:39:35.612809 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:35.612720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" event={"ID":"12e99f9d-9a81-4765-b2b4-6adeeabe6443","Type":"ContainerStarted","Data":"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"}
Jul 26 16:39:35.613168 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:35.612887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:35.634938 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:35.634888    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" podStartSLOduration=1.078256459 podStartE2EDuration="2.634872785s" totalImagesPullingTime="1.556616326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:39:35.633521567 +0000 UTC m=+2971.571645904" watchObservedRunningTime="2026-07-26 16:39:35.634872785 +0000 UTC m=+2971.572997107"
Jul 26 16:39:40.980005 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:40.979973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:39:46.618882 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:46.618846    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:39:57.831665 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:39:57.831631    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh_12e99f9d-9a81-4765-b2b4-6adeeabe6443/payload-processing/0.log"
Jul 26 16:40:21.648498 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.648460    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:40:21.650873 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.650856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.653295 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.653272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bdfbca\"/\"openshift-service-ca.crt\""
Jul 26 16:40:21.654416 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.654399    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bdfbca\"/\"default-dockercfg-sf695\""
Jul 26 16:40:21.654472 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.654434    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-bdfbca\"/\"kube-root-ca.crt\""
Jul 26 16:40:21.654472 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.654448    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-bdfbca\"/\"ipp-route-bdfbca-kserve-self-signed-certs\""
Jul 26 16:40:21.660246 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.660221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:40:21.705121 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.705278 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.705278 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.705278 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.705405 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.705405 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.705376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8w52\" (UniqueName: \"kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806462 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806462 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806470    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806783 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806783 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806783 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806783 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8w52\" (UniqueName: \"kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.806995 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806900    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.807037 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.806998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.807086 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.807066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.808835 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.808818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.809166 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.809147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.814074 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.814051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8w52\" (UniqueName: \"kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52\") pod \"ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") " pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:21.960505 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:21.960419    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:22.090060 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:22.090037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:40:22.092583 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:40:22.092553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42d95037_01e9_4de3_b319_712c44b4257e.slice/crio-ba617975cf641f4367c0cd32b77c54ec2a95b276ada94bc30aa1e47d7869f991 WatchSource:0}: Error finding container ba617975cf641f4367c0cd32b77c54ec2a95b276ada94bc30aa1e47d7869f991: Status 404 returned error can't find the container with id ba617975cf641f4367c0cd32b77c54ec2a95b276ada94bc30aa1e47d7869f991
Jul 26 16:40:22.826530 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:22.826486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" event={"ID":"42d95037-01e9-4de3-b319-712c44b4257e","Type":"ContainerStarted","Data":"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"}
Jul 26 16:40:22.826920 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:22.826536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" event={"ID":"42d95037-01e9-4de3-b319-712c44b4257e","Type":"ContainerStarted","Data":"ba617975cf641f4367c0cd32b77c54ec2a95b276ada94bc30aa1e47d7869f991"}
Jul 26 16:40:25.846678 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:25.846623    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" podStartSLOduration=4.8466062 podStartE2EDuration="4.8466062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:40:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:40:22.851445886 +0000 UTC m=+3018.789570217" watchObservedRunningTime="2026-07-26 16:40:25.8466062 +0000 UTC m=+3021.784730529"
Jul 26 16:40:25.847640 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:25.847623    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:40:31.960811 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:31.960767    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:31.961190 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:31.960826    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:31.973288 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:31.973259    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:32.883424 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:32.883389    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:40:54.155336 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:40:54.155302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:41:05.523548 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:05.523521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh_12e99f9d-9a81-4765-b2b4-6adeeabe6443/payload-processing/0.log"
Jul 26 16:41:12.741462 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.738809    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:41:12.745802 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.745774    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.748724 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.748674    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-3e477e\""
Jul 26 16:41:12.748724 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.748712    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-3e477e-dockercfg-8dsn2\""
Jul 26 16:41:12.757244 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.757218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:41:12.801591 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.801551    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:41:12.804879 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.804855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:12.814213 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.814185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:41:12.848526 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.848491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.848734 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.848625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2btj\" (UniqueName: \"kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.949338 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.949291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2btj\" (UniqueName: \"kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.949338 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.949340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlkvv\" (UniqueName: \"kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:12.949596 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.949371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:12.949596 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.949404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.950216 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.950190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:12.958652 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:12.958627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2btj\" (UniqueName: \"kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj\") pod \"payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:13.049987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.049891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlkvv\" (UniqueName: \"kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:13.049987 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.049937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:13.050651 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.050626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:13.056130 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.056108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:13.058510 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.058485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlkvv\" (UniqueName: \"kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv\") pod \"payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:13.115860 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.115832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:13.202261 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.202231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:41:13.204648 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:41:13.204623    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c731400_b4e5_4609_9aec_d05b948e57c8.slice/crio-60b31d4a4732fde7285c02439c1155c6759ea211bef0feeea17bdab4883a22e2 WatchSource:0}: Error finding container 60b31d4a4732fde7285c02439c1155c6759ea211bef0feeea17bdab4883a22e2: Status 404 returned error can't find the container with id 60b31d4a4732fde7285c02439c1155c6759ea211bef0feeea17bdab4883a22e2
Jul 26 16:41:13.264373 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:13.264347    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:41:13.266312 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:41:13.266290    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12b250f_6c08_4074_be96_1ff415a122b7.slice/crio-e3d4015b50b8efe07ee1db58d49532748e04651dc01f6c66f1b3c38c54b588d7 WatchSource:0}: Error finding container e3d4015b50b8efe07ee1db58d49532748e04651dc01f6c66f1b3c38c54b588d7: Status 404 returned error can't find the container with id e3d4015b50b8efe07ee1db58d49532748e04651dc01f6c66f1b3c38c54b588d7
Jul 26 16:41:14.068532 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.068497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" event={"ID":"b12b250f-6c08-4074-be96-1ff415a122b7","Type":"ContainerStarted","Data":"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"}
Jul 26 16:41:14.068980 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.068559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" event={"ID":"b12b250f-6c08-4074-be96-1ff415a122b7","Type":"ContainerStarted","Data":"e3d4015b50b8efe07ee1db58d49532748e04651dc01f6c66f1b3c38c54b588d7"}
Jul 26 16:41:14.068980 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.068606    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:14.070027 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.070007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" event={"ID":"0c731400-b4e5-4609-9aec-d05b948e57c8","Type":"ContainerStarted","Data":"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"}
Jul 26 16:41:14.070146 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.070042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" event={"ID":"0c731400-b4e5-4609-9aec-d05b948e57c8","Type":"ContainerStarted","Data":"60b31d4a4732fde7285c02439c1155c6759ea211bef0feeea17bdab4883a22e2"}
Jul 26 16:41:14.070146 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.070075    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:14.086212 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.086174    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" podStartSLOduration=2.086161685 podStartE2EDuration="2.086161685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:14.084703059 +0000 UTC m=+3070.022827383" watchObservedRunningTime="2026-07-26 16:41:14.086161685 +0000 UTC m=+3070.024285993"
Jul 26 16:41:14.101152 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:14.101104    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" podStartSLOduration=2.101089946 podStartE2EDuration="2.101089946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:14.099167586 +0000 UTC m=+3070.037291917" watchObservedRunningTime="2026-07-26 16:41:14.101089946 +0000 UTC m=+3070.039214305"
Jul 26 16:41:21.171056 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.171020    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:21.174532 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.174516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:21.176712 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.176675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sncbs\""
Jul 26 16:41:21.185095 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.185074    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:21.326643 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.326611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9s2\" (UniqueName: \"kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2\") pod \"kuadrant-operator-catalog-r5scl\" (UID: \"82cbb054-2abd-4164-a7e0-f4fa16107834\") " pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:21.427260 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.427179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9s2\" (UniqueName: \"kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2\") pod \"kuadrant-operator-catalog-r5scl\" (UID: \"82cbb054-2abd-4164-a7e0-f4fa16107834\") " pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:21.435983 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.435952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9s2\" (UniqueName: \"kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2\") pod \"kuadrant-operator-catalog-r5scl\" (UID: \"82cbb054-2abd-4164-a7e0-f4fa16107834\") " pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:21.449544 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.449521    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:41:21.484126 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.484102    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:21.612093 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:21.612063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:21.615226 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:41:21.615194    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cbb054_2abd_4164_a7e0_f4fa16107834.slice/crio-5c81f3b7e4ce9c717f4c84a1cb8c1ddfaab9b835879a5f589f8f16c3f15ff89e WatchSource:0}: Error finding container 5c81f3b7e4ce9c717f4c84a1cb8c1ddfaab9b835879a5f589f8f16c3f15ff89e: Status 404 returned error can't find the container with id 5c81f3b7e4ce9c717f4c84a1cb8c1ddfaab9b835879a5f589f8f16c3f15ff89e
Jul 26 16:41:22.111498 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:22.111466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" event={"ID":"82cbb054-2abd-4164-a7e0-f4fa16107834","Type":"ContainerStarted","Data":"5c81f3b7e4ce9c717f4c84a1cb8c1ddfaab9b835879a5f589f8f16c3f15ff89e"}
Jul 26 16:41:24.123475 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:24.123433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" event={"ID":"82cbb054-2abd-4164-a7e0-f4fa16107834","Type":"ContainerStarted","Data":"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"}
Jul 26 16:41:25.076099 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:25.076047    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.41:9004: connect: connection refused"
Jul 26 16:41:25.076602 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:25.076583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:41:25.100578 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:25.100531    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" podStartSLOduration=1.814078436 podStartE2EDuration="4.100517791s" totalImagesPullingTime="2.286439355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:41:24.140137215 +0000 UTC m=+3080.078261545" watchObservedRunningTime="2026-07-26 16:41:25.100517791 +0000 UTC m=+3081.038642120"
Jul 26 16:41:31.484286 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:31.484243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:31.484831 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:31.484304    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:31.505665 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:31.505636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:32.183204 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:32.183177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:32.226087 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:32.226052    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:34.171670 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:34.171622    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" podUID="82cbb054-2abd-4164-a7e0-f4fa16107834" containerName="registry-server" containerID="cri-o://6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e" gracePeriod=2
Jul 26 16:41:34.418840 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:34.418813    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:34.540699 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:34.540651    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9s2\" (UniqueName: \"kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2\") pod \"82cbb054-2abd-4164-a7e0-f4fa16107834\" (UID: \"82cbb054-2abd-4164-a7e0-f4fa16107834\") "
Jul 26 16:41:34.542700 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:34.542666    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2" (OuterVolumeSpecName: "kube-api-access-wm9s2") pod "82cbb054-2abd-4164-a7e0-f4fa16107834" (UID: "82cbb054-2abd-4164-a7e0-f4fa16107834"). InnerVolumeSpecName "kube-api-access-wm9s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:41:34.642213 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:34.642179    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9s2\" (UniqueName: \"kubernetes.io/projected/82cbb054-2abd-4164-a7e0-f4fa16107834-kube-api-access-wm9s2\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:41:35.075275 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.075243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:41:35.176918 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.176881    2576 generic.go:356] "Generic (PLEG): container finished" podID="82cbb054-2abd-4164-a7e0-f4fa16107834" containerID="6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e" exitCode=0
Jul 26 16:41:35.177303 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.176928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" event={"ID":"82cbb054-2abd-4164-a7e0-f4fa16107834","Type":"ContainerDied","Data":"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"}
Jul 26 16:41:35.177303 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.176928    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5scl"
Jul 26 16:41:35.177303 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.176979    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5scl" event={"ID":"82cbb054-2abd-4164-a7e0-f4fa16107834","Type":"ContainerDied","Data":"5c81f3b7e4ce9c717f4c84a1cb8c1ddfaab9b835879a5f589f8f16c3f15ff89e"}
Jul 26 16:41:35.177303 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.177006    2576 scope.go:117] "RemoveContainer" containerID="6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"
Jul 26 16:41:35.185904 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.185888    2576 scope.go:117] "RemoveContainer" containerID="6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"
Jul 26 16:41:35.186119 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:41:35.186099    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e\": container with ID starting with 6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e not found: ID does not exist" containerID="6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"
Jul 26 16:41:35.186184 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.186132    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e"} err="failed to get container status \"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e\": rpc error: code = NotFound desc = could not find container \"6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e\": container with ID starting with 6df11c7789d470313389140e91599d97b798b6e6ee61796baae5de1cbfc3fb6e not found: ID does not exist"
Jul 26 16:41:35.194771 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.194744    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:35.198591 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:35.198572    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5scl"]
Jul 26 16:41:36.560439 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:36.560409    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cbb054-2abd-4164-a7e0-f4fa16107834" path="/var/lib/kubelet/pods/82cbb054-2abd-4164-a7e0-f4fa16107834/volumes"
Jul 26 16:41:40.223762 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.223716    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"]
Jul 26 16:41:40.224146 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.224122    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cbb054-2abd-4164-a7e0-f4fa16107834" containerName="registry-server"
Jul 26 16:41:40.224146 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.224134    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cbb054-2abd-4164-a7e0-f4fa16107834" containerName="registry-server"
Jul 26 16:41:40.224219 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.224188    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cbb054-2abd-4164-a7e0-f4fa16107834" containerName="registry-server"
Jul 26 16:41:40.228651 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.228624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:40.231965 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.231944    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:41:40.232117 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.232090    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:41:40.237706 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.237659    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"]
Jul 26 16:41:40.289978 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.289940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh\" (UID: \"1e109baf-0f4b-4f29-aa8b-577c171314c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:40.390395 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.390350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh\" (UID: \"1e109baf-0f4b-4f29-aa8b-577c171314c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:40.391061 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.391043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh\" (UID: \"1e109baf-0f4b-4f29-aa8b-577c171314c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:40.545174 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.545079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:40.678709 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:40.678642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"]
Jul 26 16:41:40.681649 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:41:40.681623    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e109baf_0f4b_4f29_aa8b_577c171314c9.slice/crio-c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f WatchSource:0}: Error finding container c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f: Status 404 returned error can't find the container with id c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f
Jul 26 16:41:41.206643 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:41.206606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh" event={"ID":"1e109baf-0f4b-4f29-aa8b-577c171314c9","Type":"ContainerStarted","Data":"c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f"}
Jul 26 16:41:51.256963 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:51.256922    2576 generic.go:356] "Generic (PLEG): container finished" podID="1e109baf-0f4b-4f29-aa8b-577c171314c9" containerID="76a6b994445984cb0400f1a1fbd0cfa909a30e51f29bc9c1d98d5811a0bb4b28" exitCode=0
Jul 26 16:41:51.257363 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:51.256976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh" event={"ID":"1e109baf-0f4b-4f29-aa8b-577c171314c9","Type":"ContainerDied","Data":"76a6b994445984cb0400f1a1fbd0cfa909a30e51f29bc9c1d98d5811a0bb4b28"}
Jul 26 16:41:52.385476 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:52.385455    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:52.495884 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:52.495844    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca\") pod \"1e109baf-0f4b-4f29-aa8b-577c171314c9\" (UID: \"1e109baf-0f4b-4f29-aa8b-577c171314c9\") "
Jul 26 16:41:52.496205 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:52.496184    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e109baf-0f4b-4f29-aa8b-577c171314c9" (UID: "1e109baf-0f4b-4f29-aa8b-577c171314c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:41:52.597444 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:52.597340    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e109baf-0f4b-4f29-aa8b-577c171314c9-maas-api-service-ca\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:41:53.266273 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:53.266246    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"
Jul 26 16:41:53.266273 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:53.266259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh" event={"ID":"1e109baf-0f4b-4f29-aa8b-577c171314c9","Type":"ContainerDied","Data":"c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f"}
Jul 26 16:41:53.266471 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:41:53.266337    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c54c76c360439d4f4e006a181d432023455b02eecbde7a3da15e13875dae602f"
Jul 26 16:42:01.677387 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.677354    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:42:01.677843 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.677559    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" podUID="0c731400-b4e5-4609-9aec-d05b948e57c8" containerName="payload-processing" containerID="cri-o://3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860" gracePeriod=30
Jul 26 16:42:01.688310 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.688286    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:42:01.688486 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.688466    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" containerName="payload-pre-processing" containerID="cri-o://9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716" gracePeriod=30
Jul 26 16:42:01.950254 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.950230    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:42:01.952729 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:01.952710    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:42:02.086136 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086103    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume\") pod \"0c731400-b4e5-4609-9aec-d05b948e57c8\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") "
Jul 26 16:42:02.086313 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086147    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2btj\" (UniqueName: \"kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj\") pod \"0c731400-b4e5-4609-9aec-d05b948e57c8\" (UID: \"0c731400-b4e5-4609-9aec-d05b948e57c8\") "
Jul 26 16:42:02.086313 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume\") pod \"b12b250f-6c08-4074-be96-1ff415a122b7\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") "
Jul 26 16:42:02.086313 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlkvv\" (UniqueName: \"kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv\") pod \"b12b250f-6c08-4074-be96-1ff415a122b7\" (UID: \"b12b250f-6c08-4074-be96-1ff415a122b7\") "
Jul 26 16:42:02.086542 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086514    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c731400-b4e5-4609-9aec-d05b948e57c8" (UID: "0c731400-b4e5-4609-9aec-d05b948e57c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:02.086665 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.086645    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b12b250f-6c08-4074-be96-1ff415a122b7" (UID: "b12b250f-6c08-4074-be96-1ff415a122b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:02.088360 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.088338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj" (OuterVolumeSpecName: "kube-api-access-c2btj") pod "0c731400-b4e5-4609-9aec-d05b948e57c8" (UID: "0c731400-b4e5-4609-9aec-d05b948e57c8"). InnerVolumeSpecName "kube-api-access-c2btj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:02.088360 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.088349    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv" (OuterVolumeSpecName: "kube-api-access-rlkvv") pod "b12b250f-6c08-4074-be96-1ff415a122b7" (UID: "b12b250f-6c08-4074-be96-1ff415a122b7"). InnerVolumeSpecName "kube-api-access-rlkvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:02.187577 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.187462    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlkvv\" (UniqueName: \"kubernetes.io/projected/b12b250f-6c08-4074-be96-1ff415a122b7-kube-api-access-rlkvv\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:02.187577 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.187527    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c731400-b4e5-4609-9aec-d05b948e57c8-plugins-config-volume\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:02.187577 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.187541    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2btj\" (UniqueName: \"kubernetes.io/projected/0c731400-b4e5-4609-9aec-d05b948e57c8-kube-api-access-c2btj\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:02.187577 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.187554    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b12b250f-6c08-4074-be96-1ff415a122b7-plugins-config-volume\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:02.309563 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.309533    2576 generic.go:356] "Generic (PLEG): container finished" podID="b12b250f-6c08-4074-be96-1ff415a122b7" containerID="9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716" exitCode=0
Jul 26 16:42:02.309751 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.309575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"
Jul 26 16:42:02.309751 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.309602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" event={"ID":"b12b250f-6c08-4074-be96-1ff415a122b7","Type":"ContainerDied","Data":"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"}
Jul 26 16:42:02.309751 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.309642    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps" event={"ID":"b12b250f-6c08-4074-be96-1ff415a122b7","Type":"ContainerDied","Data":"e3d4015b50b8efe07ee1db58d49532748e04651dc01f6c66f1b3c38c54b588d7"}
Jul 26 16:42:02.309751 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.309663    2576 scope.go:117] "RemoveContainer" containerID="9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"
Jul 26 16:42:02.310879 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.310855    2576 generic.go:356] "Generic (PLEG): container finished" podID="0c731400-b4e5-4609-9aec-d05b948e57c8" containerID="3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860" exitCode=0
Jul 26 16:42:02.310963 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.310881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" event={"ID":"0c731400-b4e5-4609-9aec-d05b948e57c8","Type":"ContainerDied","Data":"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"}
Jul 26 16:42:02.310963 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.310908    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"
Jul 26 16:42:02.310963 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.310923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc" event={"ID":"0c731400-b4e5-4609-9aec-d05b948e57c8","Type":"ContainerDied","Data":"60b31d4a4732fde7285c02439c1155c6759ea211bef0feeea17bdab4883a22e2"}
Jul 26 16:42:02.318164 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.318146    2576 scope.go:117] "RemoveContainer" containerID="9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"
Jul 26 16:42:02.318445 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:42:02.318424    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716\": container with ID starting with 9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716 not found: ID does not exist" containerID="9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"
Jul 26 16:42:02.318517 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.318457    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716"} err="failed to get container status \"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716\": rpc error: code = NotFound desc = could not find container \"9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716\": container with ID starting with 9a89a5c3ed8598248c346dcf5cf95c3ff9e2a60ce681da49fb54a1ac86756716 not found: ID does not exist"
Jul 26 16:42:02.318517 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.318481    2576 scope.go:117] "RemoveContainer" containerID="3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"
Jul 26 16:42:02.326241 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.326225    2576 scope.go:117] "RemoveContainer" containerID="3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"
Jul 26 16:42:02.326473 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:42:02.326454    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860\": container with ID starting with 3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860 not found: ID does not exist" containerID="3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"
Jul 26 16:42:02.326526 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.326477    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860"} err="failed to get container status \"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860\": rpc error: code = NotFound desc = could not find container \"3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860\": container with ID starting with 3efd489c7f1b2bbe313faca83b14e91b6fe615ec98473664c8b8135dd7d41860 not found: ID does not exist"
Jul 26 16:42:02.343179 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.343160    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:42:02.347470 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.347448    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-3e477e-584b77d7f8-qlfgc"]
Jul 26 16:42:02.361372 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.361346    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:42:02.364889 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.364866    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-3e477e-777444f84-pvnps"]
Jul 26 16:42:02.560340 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.560308    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c731400-b4e5-4609-9aec-d05b948e57c8" path="/var/lib/kubelet/pods/0c731400-b4e5-4609-9aec-d05b948e57c8/volumes"
Jul 26 16:42:02.560678 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:02.560666    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" path="/var/lib/kubelet/pods/b12b250f-6c08-4074-be96-1ff415a122b7/volumes"
Jul 26 16:42:05.356637 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:05.356595    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"]
Jul 26 16:42:05.364424 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:05.364398    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-3e477e-8j4rh"]
Jul 26 16:42:06.357309 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:06.357274    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:42:06.559529 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:06.559497    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e109baf-0f4b-4f29-aa8b-577c171314c9" path="/var/lib/kubelet/pods/1e109baf-0f4b-4f29-aa8b-577c171314c9/volumes"
Jul 26 16:42:17.777084 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777051    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"]
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777380    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" containerName="payload-pre-processing"
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777390    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" containerName="payload-pre-processing"
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777405    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e109baf-0f4b-4f29-aa8b-577c171314c9" containerName="revoke-keys"
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777411    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e109baf-0f4b-4f29-aa8b-577c171314c9" containerName="revoke-keys"
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777423    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c731400-b4e5-4609-9aec-d05b948e57c8" containerName="payload-processing"
Jul 26 16:42:17.777437 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777428    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c731400-b4e5-4609-9aec-d05b948e57c8" containerName="payload-processing"
Jul 26 16:42:17.777623 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777480    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c731400-b4e5-4609-9aec-d05b948e57c8" containerName="payload-processing"
Jul 26 16:42:17.777623 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777487    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e109baf-0f4b-4f29-aa8b-577c171314c9" containerName="revoke-keys"
Jul 26 16:42:17.777623 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.777494    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12b250f-6c08-4074-be96-1ff415a122b7" containerName="payload-pre-processing"
Jul 26 16:42:17.780272 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.780256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:17.782525 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.782501    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:42:17.782669 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.782613    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:42:17.792459 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.792436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"]
Jul 26 16:42:17.925919 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:17.925881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm\" (UID: \"44bf077d-45fa-4b3d-b910-78bda31c599f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:18.026935 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:18.026897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm\" (UID: \"44bf077d-45fa-4b3d-b910-78bda31c599f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:18.027599 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:18.027551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm\" (UID: \"44bf077d-45fa-4b3d-b910-78bda31c599f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:18.089904 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:18.089854    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:18.223204 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:18.223178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"]
Jul 26 16:42:18.225565 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:42:18.225538    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bf077d_45fa_4b3d_b910_78bda31c599f.slice/crio-ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01 WatchSource:0}: Error finding container ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01: Status 404 returned error can't find the container with id ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01
Jul 26 16:42:18.388047 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:18.387959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm" event={"ID":"44bf077d-45fa-4b3d-b910-78bda31c599f","Type":"ContainerStarted","Data":"ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01"}
Jul 26 16:42:19.394047 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:19.394011    2576 generic.go:356] "Generic (PLEG): container finished" podID="44bf077d-45fa-4b3d-b910-78bda31c599f" containerID="60c4ac23991ef0039204ce4ae3fef81bd66d0c6182d5f0cd11993d13e15a27f4" exitCode=0
Jul 26 16:42:19.394429 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:19.394062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm" event={"ID":"44bf077d-45fa-4b3d-b910-78bda31c599f","Type":"ContainerDied","Data":"60c4ac23991ef0039204ce4ae3fef81bd66d0c6182d5f0cd11993d13e15a27f4"}
Jul 26 16:42:20.533449 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:20.533425    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:20.649856 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:20.649784    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca\") pod \"44bf077d-45fa-4b3d-b910-78bda31c599f\" (UID: \"44bf077d-45fa-4b3d-b910-78bda31c599f\") "
Jul 26 16:42:20.650111 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:20.650089    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "44bf077d-45fa-4b3d-b910-78bda31c599f" (UID: "44bf077d-45fa-4b3d-b910-78bda31c599f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:42:20.750667 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:20.750634    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44bf077d-45fa-4b3d-b910-78bda31c599f-maas-api-service-ca\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:21.410001 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:21.409970    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"
Jul 26 16:42:21.410153 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:21.410009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm" event={"ID":"44bf077d-45fa-4b3d-b910-78bda31c599f","Type":"ContainerDied","Data":"ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01"}
Jul 26 16:42:21.410153 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:21.410089    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec5b1b911ac7b8b97a0fe6baf199204c674ba0d02e25f287b9cfa8683795ea01"
Jul 26 16:42:32.009613 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:32.009572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:42:37.865995 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:37.865955    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"]
Jul 26 16:42:37.869303 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:37.869278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-bdfbca-zhvrm"]
Jul 26 16:42:38.560122 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:38.560086    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44bf077d-45fa-4b3d-b910-78bda31c599f" path="/var/lib/kubelet/pods/44bf077d-45fa-4b3d-b910-78bda31c599f/volumes"
Jul 26 16:42:43.256149 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:43.256106    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:42:45.478292 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:45.478253    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:42:58.275339 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.275295    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" podUID="42d95037-01e9-4de3-b319-712c44b4257e" containerName="main" containerID="cri-o://2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510" gracePeriod=45
Jul 26 16:42:58.522300 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.522271    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:42:58.590856 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.590780    2576 generic.go:356] "Generic (PLEG): container finished" podID="42d95037-01e9-4de3-b319-712c44b4257e" containerID="2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510" exitCode=0
Jul 26 16:42:58.590856 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.590822    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"
Jul 26 16:42:58.591074 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.590870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" event={"ID":"42d95037-01e9-4de3-b319-712c44b4257e","Type":"ContainerDied","Data":"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"}
Jul 26 16:42:58.591074 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.590913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r" event={"ID":"42d95037-01e9-4de3-b319-712c44b4257e","Type":"ContainerDied","Data":"ba617975cf641f4367c0cd32b77c54ec2a95b276ada94bc30aa1e47d7869f991"}
Jul 26 16:42:58.591074 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.590936    2576 scope.go:117] "RemoveContainer" containerID="2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"
Jul 26 16:42:58.599172 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.599152    2576 scope.go:117] "RemoveContainer" containerID="2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"
Jul 26 16:42:58.599425 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:42:58.599407    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510\": container with ID starting with 2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510 not found: ID does not exist" containerID="2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"
Jul 26 16:42:58.599468 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.599433    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510"} err="failed to get container status \"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510\": rpc error: code = NotFound desc = could not find container \"2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510\": container with ID starting with 2e8772ff33aaa02d0289b183468b90cf2d38b26260e23441a4e1ec1391d92510 not found: ID does not exist"
Jul 26 16:42:58.681967 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.681932    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.681967 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.681973    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.682216 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8w52\" (UniqueName: \"kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.682216 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.682216 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682065    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.682216 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home\") pod \"42d95037-01e9-4de3-b319-712c44b4257e\" (UID: \"42d95037-01e9-4de3-b319-712c44b4257e\") "
Jul 26 16:42:58.682426 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682297    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache" (OuterVolumeSpecName: "model-cache") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:58.682426 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682354    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:58.682505 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.682433    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home" (OuterVolumeSpecName: "home") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:58.684425 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.684401    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 16:42:58.684425 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.684415    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52" (OuterVolumeSpecName: "kube-api-access-q8w52") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "kube-api-access-q8w52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:42:58.684545 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.684420    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm" (OuterVolumeSpecName: "dshm") pod "42d95037-01e9-4de3-b319-712c44b4257e" (UID: "42d95037-01e9-4de3-b319-712c44b4257e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 16:42:58.783180 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783120    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d95037-01e9-4de3-b319-712c44b4257e-tls-certs\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.783180 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783171    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-model-cache\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.783180 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783185    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8w52\" (UniqueName: \"kubernetes.io/projected/42d95037-01e9-4de3-b319-712c44b4257e-kube-api-access-q8w52\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.783427 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783197    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-dshm\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.783427 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783210    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-tmp-dir\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.783427 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.783220    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42d95037-01e9-4de3-b319-712c44b4257e-home\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:42:58.913347 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.913315    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:42:58.920763 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:42:58.920728    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-bdfbca/ipp-route-bdfbca-kserve-64cb9f5bf9-dbz8r"]
Jul 26 16:43:00.559783 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:00.559749    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d95037-01e9-4de3-b319-712c44b4257e" path="/var/lib/kubelet/pods/42d95037-01e9-4de3-b319-712c44b4257e/volumes"
Jul 26 16:43:28.714447 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714407    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"]
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714774    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44bf077d-45fa-4b3d-b910-78bda31c599f" containerName="revoke-keys"
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714787    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44bf077d-45fa-4b3d-b910-78bda31c599f" containerName="revoke-keys"
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714816    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d95037-01e9-4de3-b319-712c44b4257e" containerName="main"
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714821    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d95037-01e9-4de3-b319-712c44b4257e" containerName="main"
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714886    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d95037-01e9-4de3-b319-712c44b4257e" containerName="main"
Jul 26 16:43:28.714909 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.714896    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44bf077d-45fa-4b3d-b910-78bda31c599f" containerName="revoke-keys"
Jul 26 16:43:28.717853 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.717837    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:28.720088 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.720068    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mlwwk\""
Jul 26 16:43:28.720552 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.720533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 16:43:28.729271 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.729243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"]
Jul 26 16:43:28.742508 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.742484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz\" (UID: \"cc67b2d8-3745-44f2-ba76-56f503650326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:28.842953 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.842913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz\" (UID: \"cc67b2d8-3745-44f2-ba76-56f503650326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:28.843545 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:28.843521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz\" (UID: \"cc67b2d8-3745-44f2-ba76-56f503650326\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:29.028157 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:29.028125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:29.169857 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:29.169831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"]
Jul 26 16:43:29.172373 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:43:29.172347    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc67b2d8_3745_44f2_ba76_56f503650326.slice/crio-11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501 WatchSource:0}: Error finding container 11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501: Status 404 returned error can't find the container with id 11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501
Jul 26 16:43:29.737295 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:29.737259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz" event={"ID":"cc67b2d8-3745-44f2-ba76-56f503650326","Type":"ContainerStarted","Data":"33c2d118b0ab70c016dff983fea19222eb73e459a291e8ed5e3420fe5014fb94"}
Jul 26 16:43:29.737645 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:29.737314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz" event={"ID":"cc67b2d8-3745-44f2-ba76-56f503650326","Type":"ContainerStarted","Data":"11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501"}
Jul 26 16:43:29.803560 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:29.803501    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz" podStartSLOduration=1.8034831580000001 podStartE2EDuration="1.803483158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 16:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:43:29.803108758 +0000 UTC m=+3205.741233088" watchObservedRunningTime="2026-07-26 16:43:29.803483158 +0000 UTC m=+3205.741607547"
Jul 26 16:43:30.743055 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:30.743018    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc67b2d8-3745-44f2-ba76-56f503650326" containerID="33c2d118b0ab70c016dff983fea19222eb73e459a291e8ed5e3420fe5014fb94" exitCode=0
Jul 26 16:43:30.743458 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:30.743105    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz" event={"ID":"cc67b2d8-3745-44f2-ba76-56f503650326","Type":"ContainerDied","Data":"33c2d118b0ab70c016dff983fea19222eb73e459a291e8ed5e3420fe5014fb94"}
Jul 26 16:43:31.878636 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:31.878610    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:31.969898 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:31.969863    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca\") pod \"cc67b2d8-3745-44f2-ba76-56f503650326\" (UID: \"cc67b2d8-3745-44f2-ba76-56f503650326\") "
Jul 26 16:43:31.970208 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:31.970185    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc67b2d8-3745-44f2-ba76-56f503650326" (UID: "cc67b2d8-3745-44f2-ba76-56f503650326"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:43:32.071210 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:32.071132    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc67b2d8-3745-44f2-ba76-56f503650326-maas-api-service-ca\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:43:32.754350 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:32.754323    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"
Jul 26 16:43:32.754350 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:32.754335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz" event={"ID":"cc67b2d8-3745-44f2-ba76-56f503650326","Type":"ContainerDied","Data":"11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501"}
Jul 26 16:43:32.754578 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:32.754384    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11d98efe95753cf9ca0c6ade56105ae1b99ecad0d3a9307e478502eed10df501"
Jul 26 16:43:41.168674 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.168641    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:43:41.169258 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.168867    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" podUID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" containerName="payload-processing" containerID="cri-o://d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d" gracePeriod=30
Jul 26 16:43:41.215329 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:43:41.215298    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e99f9d_9a81_4765_b2b4_6adeeabe6443.slice/crio-conmon-d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d.scope\": RecentStats: unable to find data in memory cache]"
Jul 26 16:43:41.426543 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.426484    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:43:41.554962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.554931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thh7w\" (UniqueName: \"kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w\") pod \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") "
Jul 26 16:43:41.555130 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.555024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume\") pod \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\" (UID: \"12e99f9d-9a81-4765-b2b4-6adeeabe6443\") "
Jul 26 16:43:41.555381 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.555354    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12e99f9d-9a81-4765-b2b4-6adeeabe6443" (UID: "12e99f9d-9a81-4765-b2b4-6adeeabe6443"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 16:43:41.556945 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.556926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w" (OuterVolumeSpecName: "kube-api-access-thh7w") pod "12e99f9d-9a81-4765-b2b4-6adeeabe6443" (UID: "12e99f9d-9a81-4765-b2b4-6adeeabe6443"). InnerVolumeSpecName "kube-api-access-thh7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 16:43:41.655765 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.655732    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thh7w\" (UniqueName: \"kubernetes.io/projected/12e99f9d-9a81-4765-b2b4-6adeeabe6443-kube-api-access-thh7w\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:43:41.655765 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.655760    2576 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12e99f9d-9a81-4765-b2b4-6adeeabe6443-plugins-config-volume\") on node \"ip-10-0-128-173.ec2.internal\" DevicePath \"\""
Jul 26 16:43:41.797640 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.797599    2576 generic.go:356] "Generic (PLEG): container finished" podID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" containerID="d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d" exitCode=0
Jul 26 16:43:41.797640 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.797646    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"
Jul 26 16:43:41.797883 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.797704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" event={"ID":"12e99f9d-9a81-4765-b2b4-6adeeabe6443","Type":"ContainerDied","Data":"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"}
Jul 26 16:43:41.797883 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.797761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh" event={"ID":"12e99f9d-9a81-4765-b2b4-6adeeabe6443","Type":"ContainerDied","Data":"08206128649d0d99febc0071fff45dc989275b34df4e8834ef1cdd349fc9f5cf"}
Jul 26 16:43:41.797883 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.797784    2576 scope.go:117] "RemoveContainer" containerID="d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"
Jul 26 16:43:41.806580 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.806559    2576 scope.go:117] "RemoveContainer" containerID="d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"
Jul 26 16:43:41.806884 ip-10-0-128-173 kubenswrapper[2576]: E0726 16:43:41.806864    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d\": container with ID starting with d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d not found: ID does not exist" containerID="d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"
Jul 26 16:43:41.806988 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.806892    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d"} err="failed to get container status \"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d\": rpc error: code = NotFound desc = could not find container \"d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d\": container with ID starting with d8e8edda2ec2fae8b28a37a1f33a90a4c09c2712a1d6ee79c22d88a650f8ce4d not found: ID does not exist"
Jul 26 16:43:41.818751 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.818710    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:43:41.827300 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:41.827278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-33839d-758f5d8468-g9qhh"]
Jul 26 16:43:42.560506 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:42.560474    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" path="/var/lib/kubelet/pods/12e99f9d-9a81-4765-b2b4-6adeeabe6443/volumes"
Jul 26 16:43:43.938652 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:43.938614    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"]
Jul 26 16:43:43.944428 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:43.944399    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-33839d-g9csz"]
Jul 26 16:43:44.560086 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:44.560056    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc67b2d8-3745-44f2-ba76-56f503650326" path="/var/lib/kubelet/pods/cc67b2d8-3745-44f2-ba76-56f503650326/volumes"
Jul 26 16:43:44.716535 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:43:44.716501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:44:05.783353 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:05.783313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:44:29.759962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:29.759928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wqr6b"]
Jul 26 16:44:38.296724 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:38.296671    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f579c9485-h89wm_e2b988bf-6139-47a0-a644-00f89132ca42/authorino/0.log"
Jul 26 16:44:45.028756 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:45.028725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-zhtsx_33b57c1e-ac6c-4712-81b3-142c51e32c10/copy-manifests/0.log"
Jul 26 16:44:45.050893 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:45.050866    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-zhtsx_33b57c1e-ac6c-4712-81b3-142c51e32c10/manager/0.log"
Jul 26 16:44:47.337680 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:47.337646    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f579c9485-h89wm_e2b988bf-6139-47a0-a644-00f89132ca42/authorino/0.log"
Jul 26 16:44:47.711986 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:47.711909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jtk9f_3bf8bfba-9cc5-4006-a32e-8142834c3fe9/kuadrant-console-plugin/0.log"
Jul 26 16:44:48.107881 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:48.107846    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wqr6b_7ea0162f-cfec-4e24-89a0-3949fae01d03/limitador/0.log"
Jul 26 16:44:48.984587 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:48.984554    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfd866646-gn54l_67653c7a-e556-4af4-8186-0eb52dbba186/kube-auth-proxy/0.log"
Jul 26 16:44:49.518611 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:49.518582    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dd998b55c-hwxgl_ced0987f-8eec-4c83-975f-b82334f37e44/router/0.log"
Jul 26 16:44:50.370077 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:50.370045    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ngrwj_9a0cb171-3333-4d64-a834-74c94c8c0f88/main/0.log"
Jul 26 16:44:50.490162 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:50.490128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-9qh7s_84239f29-6027-4772-b6ad-1da7b62e93f3/main/0.log"
Jul 26 16:44:59.672916 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:59.672886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4qfqv_ad2d4624-43e8-4832-a099-d8d88e62aa3b/global-pull-secret-syncer/0.log"
Jul 26 16:44:59.938752 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:59.938648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zhzjc_689f9e49-860e-4a57-98d7-4cff20347277/konnectivity-agent/0.log"
Jul 26 16:44:59.968985 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:44:59.968951    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-173.ec2.internal_70a21ba21338b6ba758e27d2cca1c0ab/haproxy/0.log"
Jul 26 16:45:04.835681 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:04.835647    2576 scope.go:117] "RemoveContainer" containerID="795eac32e4e65fc5031ce4fa671a77c2094d90ddaffc2ef89c9d3a6a9245a742"
Jul 26 16:45:04.845593 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:04.845536    2576 scope.go:117] "RemoveContainer" containerID="a0f5e2237fbba5186f1547ef9c215873ed2a3306ce416e5fe348b0a17eaade37"
Jul 26 16:45:05.280077 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:05.280039    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f579c9485-h89wm_e2b988bf-6139-47a0-a644-00f89132ca42/authorino/0.log"
Jul 26 16:45:05.436047 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:05.436022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-jtk9f_3bf8bfba-9cc5-4006-a32e-8142834c3fe9/kuadrant-console-plugin/0.log"
Jul 26 16:45:05.807910 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:05.807882    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wqr6b_7ea0162f-cfec-4e24-89a0-3949fae01d03/limitador/0.log"
Jul 26 16:45:07.711550 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.711504    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-2dvl8_67abce95-3575-49e8-a3cf-e77bc3ea6f1b/cluster-monitoring-operator/0.log"
Jul 26 16:45:07.742124 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.742092    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7vdxs_bbe27cc5-80dd-4ae4-8b79-62c756aa7907/kube-state-metrics/0.log"
Jul 26 16:45:07.761447 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.761415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7vdxs_bbe27cc5-80dd-4ae4-8b79-62c756aa7907/kube-rbac-proxy-main/0.log"
Jul 26 16:45:07.786792 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.786762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-7vdxs_bbe27cc5-80dd-4ae4-8b79-62c756aa7907/kube-rbac-proxy-self/0.log"
Jul 26 16:45:07.899071 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.899041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9457_2a331d4e-cae4-4563-aaa3-8953544443ca/node-exporter/0.log"
Jul 26 16:45:07.929284 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.929263    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9457_2a331d4e-cae4-4563-aaa3-8953544443ca/kube-rbac-proxy/0.log"
Jul 26 16:45:07.962660 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:07.962597    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b9457_2a331d4e-cae4-4563-aaa3-8953544443ca/init-textfile/0.log"
Jul 26 16:45:08.520766 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.520730    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8ssgd_a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada/prometheus-operator/0.log"
Jul 26 16:45:08.549485 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.549462    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8ssgd_a76e7ecf-2a7c-4deb-bd7a-81ff83cf4ada/kube-rbac-proxy/0.log"
Jul 26 16:45:08.617385 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.617349    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdf556688-7ggj7_9d6c10e4-0894-4f60-8192-2d5666ae8c89/telemeter-client/0.log"
Jul 26 16:45:08.644181 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.644155    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdf556688-7ggj7_9d6c10e4-0894-4f60-8192-2d5666ae8c89/reload/0.log"
Jul 26 16:45:08.674191 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.674157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdf556688-7ggj7_9d6c10e4-0894-4f60-8192-2d5666ae8c89/kube-rbac-proxy/0.log"
Jul 26 16:45:08.713032 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.713007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/thanos-query/0.log"
Jul 26 16:45:08.743023 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.743003    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/kube-rbac-proxy-web/0.log"
Jul 26 16:45:08.770565 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.770544    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/kube-rbac-proxy/0.log"
Jul 26 16:45:08.799402 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.799330    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/prom-label-proxy/0.log"
Jul 26 16:45:08.832969 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.832943    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/kube-rbac-proxy-rules/0.log"
Jul 26 16:45:08.863044 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:08.863017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8cfd54c5-cnfv6_b437e5ea-2e67-4a16-86f8-569b8746c571/kube-rbac-proxy-metrics/0.log"
Jul 26 16:45:09.441970 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.441935    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"]
Jul 26 16:45:09.442277 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442265    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" containerName="payload-processing"
Jul 26 16:45:09.442333 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442280    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" containerName="payload-processing"
Jul 26 16:45:09.442333 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442291    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc67b2d8-3745-44f2-ba76-56f503650326" containerName="revoke-keys"
Jul 26 16:45:09.442333 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442297    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc67b2d8-3745-44f2-ba76-56f503650326" containerName="revoke-keys"
Jul 26 16:45:09.442441 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442345    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc67b2d8-3745-44f2-ba76-56f503650326" containerName="revoke-keys"
Jul 26 16:45:09.442441 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.442352    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e99f9d-9a81-4765-b2b4-6adeeabe6443" containerName="payload-processing"
Jul 26 16:45:09.446503 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.446483    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.450229 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.450210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mkcz\"/\"kube-root-ca.crt\""
Jul 26 16:45:09.451073 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.451052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5mkcz\"/\"default-dockercfg-bdkcf\""
Jul 26 16:45:09.451172 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.451052    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5mkcz\"/\"openshift-service-ca.crt\""
Jul 26 16:45:09.459999 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.459977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"]
Jul 26 16:45:09.495031 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.495004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-sys\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.495135 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.495049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-proc\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.495135 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.495082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxr7\" (UniqueName: \"kubernetes.io/projected/1712a28b-326a-4aa2-8312-a2af00bc1c20-kube-api-access-mrxr7\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.495135 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.495107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-podres\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.495135 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.495124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-lib-modules\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595842 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595816    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-sys\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-proc\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxr7\" (UniqueName: \"kubernetes.io/projected/1712a28b-326a-4aa2-8312-a2af00bc1c20-kube-api-access-mrxr7\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595909    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-podres\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595924    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-lib-modules\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.595962 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.595932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-sys\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.596205 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.596035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-proc\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.596205 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.596044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-podres\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.596205 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.596160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1712a28b-326a-4aa2-8312-a2af00bc1c20-lib-modules\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.606914 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.606885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxr7\" (UniqueName: \"kubernetes.io/projected/1712a28b-326a-4aa2-8312-a2af00bc1c20-kube-api-access-mrxr7\") pod \"perf-node-gather-daemonset-5bt75\" (UID: \"1712a28b-326a-4aa2-8312-a2af00bc1c20\") " pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.755838 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.755812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:09.883350 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:09.883325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"]
Jul 26 16:45:09.885977 ip-10-0-128-173 kubenswrapper[2576]: W0726 16:45:09.885945    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1712a28b_326a_4aa2_8312_a2af00bc1c20.slice/crio-5efa3caf8accd66407784fc18610589fded575cd0dc98ccb312df3a77cde10d3 WatchSource:0}: Error finding container 5efa3caf8accd66407784fc18610589fded575cd0dc98ccb312df3a77cde10d3: Status 404 returned error can't find the container with id 5efa3caf8accd66407784fc18610589fded575cd0dc98ccb312df3a77cde10d3
Jul 26 16:45:10.208251 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:10.208171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75" event={"ID":"1712a28b-326a-4aa2-8312-a2af00bc1c20","Type":"ContainerStarted","Data":"52ebbc8d8f34ce4acd61d001eb3b9e091013d64b7ea1ef50d847a92c8b5c5c83"}
Jul 26 16:45:10.208251 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:10.208223    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75" event={"ID":"1712a28b-326a-4aa2-8312-a2af00bc1c20","Type":"ContainerStarted","Data":"5efa3caf8accd66407784fc18610589fded575cd0dc98ccb312df3a77cde10d3"}
Jul 26 16:45:10.208251 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:10.208243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:10.231997 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:10.231951    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75" podStartSLOduration=1.23193802 podStartE2EDuration="1.23193802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 16:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 16:45:10.227276741 +0000 UTC m=+3306.165401071" watchObservedRunningTime="2026-07-26 16:45:10.23193802 +0000 UTC m=+3306.170062350"
Jul 26 16:45:11.253553 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:11.253519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-szrcf_840bbf17-b5e3-4b45-8dea-d19912a24860/download-server/0.log"
Jul 26 16:45:13.177528 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:13.177502    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p7dm4_d0204351-51f1-45f9-a806-a01d00ab335b/dns/0.log"
Jul 26 16:45:13.225594 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:13.225564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p7dm4_d0204351-51f1-45f9-a806-a01d00ab335b/kube-rbac-proxy/0.log"
Jul 26 16:45:13.370051 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:13.370027    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gjx8b_5ff48070-2040-4d65-9ae1-3d2e695b3ebb/dns-node-resolver/0.log"
Jul 26 16:45:14.108424 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:14.108395    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-f84cf8886-6sjvn_7abc7523-bbe0-4708-8a69-97ec1bf10f1d/registry/0.log"
Jul 26 16:45:14.197257 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:14.197228    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q7kfm_f21ef924-2561-4319-9f87-2ddd8c29e3c7/node-ca/0.log"
Jul 26 16:45:15.540598 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:15.540563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfd866646-gn54l_67653c7a-e556-4af4-8186-0eb52dbba186/kube-auth-proxy/0.log"
Jul 26 16:45:15.699555 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:15.699514    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dd998b55c-hwxgl_ced0987f-8eec-4c83-975f-b82334f37e44/router/0.log"
Jul 26 16:45:16.221235 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:16.221211    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5mkcz/perf-node-gather-daemonset-5bt75"
Jul 26 16:45:16.506091 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:16.506059    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8n7jx_18cb9c03-c7f6-43b0-9c1f-434855320602/serve-healthcheck-canary/0.log"
Jul 26 16:45:17.124761 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:17.124723    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5c4hg_704ace0b-a257-4b4e-9199-5c62e4c2e19d/kube-rbac-proxy/0.log"
Jul 26 16:45:17.165469 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:17.165443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5c4hg_704ace0b-a257-4b4e-9199-5c62e4c2e19d/exporter/0.log"
Jul 26 16:45:17.200554 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:17.200521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5c4hg_704ace0b-a257-4b4e-9199-5c62e4c2e19d/extractor/0.log"
Jul 26 16:45:19.712002 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:19.711977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfd866646-gn54l_67653c7a-e556-4af4-8186-0eb52dbba186/kube-auth-proxy/0.log"
Jul 26 16:45:19.829162 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:19.829131    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dd998b55c-hwxgl_ced0987f-8eec-4c83-975f-b82334f37e44/router/0.log"
Jul 26 16:45:20.658454 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:20.658425    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-zhtsx_33b57c1e-ac6c-4712-81b3-142c51e32c10/manager/0.log"
Jul 26 16:45:20.680233 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:20.680209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-745bd4f5cc-zhtsx_33b57c1e-ac6c-4712-81b3-142c51e32c10/copy-manifests/0.log"
Jul 26 16:45:21.489054 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:21.489030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bfd866646-gn54l_67653c7a-e556-4af4-8186-0eb52dbba186/kube-auth-proxy/0.log"
Jul 26 16:45:21.611838 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:21.611799    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dd998b55c-hwxgl_ced0987f-8eec-4c83-975f-b82334f37e44/router/0.log"
Jul 26 16:45:21.966060 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:21.966026    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-868c8c7ff4-b7fg8_757f0d94-b222-4a2a-ac7b-9bbdff481c91/manager/0.log"
Jul 26 16:45:22.026761 ip-10-0-128-173 kubenswrapper[2576]: I0726 16:45:22.026725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dpl5j_81a9315e-8e46-457a-a097-b4d0a9f283ca/openshift-lws-operator/0.log"